Last October I asked you all for help in figuring out the spatial indexing algorithm used to create Esri sbn files. Using Pyshp, I had successfully decoded the file formats which I provided. However I could not figure out the algorithm used to create and populate the spatial bins within these files.
Today I'm pleased to announce this challenge has been answered. The GIS community now has access to both the sbn and sbx file format as well as the algorithm for grouping features in a shapefile into "spatial bins".
I'm glad I asked for help as this challenge turned out to be quite difficult. The brain behind this operation is Marc Pfister with some good insights from Si Parker. Marc worked tirelessly on this problem for months with a cross-country move and complete career change thrown in to make it interesting. Marc did all the heavy intellectual lifting with me playing an inquisitive, but usually short-sighted Watson to his Holmes. I generated endless series of shapefiles and one-off scripts to help Marc try and flush out the algorithm based only on subtle changes in the number of bins and features they contained as well as his past experience with spatial indexing.
When I figured out the file formats I had hoped I was just a Wikipedia search away from recognizing the spatial tree algorithm. But the solution turned out to be much more complex than that. Esri uses a sort of balanced tree that exhibits traits of several different algorithms. The system seems carefully designed but is by no means obvious. I will publish Marc's findings as soon as I can.
There are still a few shapefile cases which create puzzling but insignificant results. However we are at the 98% mark. The project goal of compatibility has been reached. There is no longer any reason to hold off on sharing the results. We are fairly certain that we are able to create sbn and sbx files which sufficiently fool ArcMap as well as other Esri packages so other software can read, use, and generate these indexes alongside the Esri suite. There is more testing to do but it seems we are out of the woods.
What we haven't done is nicely packaged all of this work up. But Marc posted a small set of Python scripts on github which demonstrate the algorithm and file handling needed to copy this capability. Over the coming months I will fold this code into Pyshp, produce better documentation on the algorithm, and provide posts on how to deal with these indexes. But for now here's what you've been waiting for:
https://github.com/drwelby/hasbeen
By the way, Marc does freelance programming. In my job, I get the opportunity to work with lots of really bright geospatial programmers and mathematicians and this guy is one of the very best I've ever seen. If you have a tough geospatial project and need some E=MC2 smarts definitely look him up.
Really nice job guys and thanks for the hard work ! I'm happy to announce that I've just added read support for .sbn files in GDAL/OGR trunk. See http://trac.osgeo.org/gdal/ticket/4719 for the details. It seems to work great, but external testing and/or code review would be very much appreciated.
ReplyDeleteThe only detail that I had a bit difficulty to figure out and that was not explicitely explained in your blog entries or in the hasbeen code was the relationship between the bins and the nodes, and especially the notion of "continuous bins", that is to say that if a node in the tree has more than 100 shapes, then it is described into several bins in the .sbn.
Very good designed blog and postings with super cool photos.
ReplyDeleteI recently found many useful information in your website especially this blog page. Among the lots of comments on your articles.procurement software
ReplyDeleteGood post. I was checking consistently this blog and I am impressed. Quite useful information specially the final component.sharepoint alternative
ReplyDeleteThe post is written in very a good manner and it entails many useful information for me. I am happy to find your distinguished way of writing the post. Now you make it easy for me to understand and implement the concept.rodent pest control
ReplyDeleteThank you all so much for participating in this comment to win! What fun it is reading all of your responses.bed bug extermination
ReplyDeleteMy husband and i complete by no limiteds ditto discotheques that sanity signify yesterday that bliss stimulant. The subsidiary fight normally swerves obey writing tenuouss, so i would likely favor to rectify sterile a cut largesss on what to avail wheel your current entwine dapper sponsor no part fidget of delightful or perhaps optical spirit.vintage clothing shops london uk
ReplyDeleteThanks for the informative writing. Would mind updating some good tips about it. I still wait your next place.vintage stores london uk
ReplyDeleteI think that you could do with some pics to drive the message home a bit, but other than that, this is great blog. recruitment agencies.money rituals
ReplyDeleteI thought it was going to be some boring old post, but it really compensated for my time. I will post a link to this page on my blog.limo services ct
ReplyDeleteMmm.. good to be here in your article or post, whatever, I think I should also work hard for my own website like I see some good and updated working in your site.limo service from jfk to ct
ReplyDeleteThere is a lot of good information on this website. Been searching and finally found something I was looking for.Xiaomi 10000mAh Powerbank
ReplyDeleteThis article blew my mind. I am very happy to be here. You don’t know how much inspiration your articles bring.navy blue canvas tote bags
ReplyDeleteI want you to thank for your time of this wonderful read!!! I definitely enjoy every little bit of it and I have you bookmarked to check out new stuff of your blog a must read blog!!desk sharing software
ReplyDeleteI really enjoyed reading on this article. I hope that other readers will also experience how I feel after reading your article. Thank you so much.custom sweaters
ReplyDeleteThis is a very good article material and it is very useful for us all. thank you . cara menggugurkan kandungan
ReplyDeleteWow! Such an amazing and helpful post this is. I really really love it. It's so good and so awesome. I am just amazed. I hope that you continue to do your work like this in the future also.book cover art
ReplyDeleteI definitely enjoying every little bit of it. It is a great website and nice share. I want to thank you. Good job! You guys do a great blog, and have some great contents. Keep up the good work.book cover design process
ReplyDeleteThis site is one thing that is needed on the internet, someone with some originality!I honestly appreciate people like you! Take care!!.please visit my web site too and let me know your opinion.Ryanair
ReplyDeleteI study lot of blog about python but you provide a very different information.Really i appreciate you for your knowledge.Thaks for sharing.keep sharing more blogs.
ReplyDeletePython Online Training
Thanks for sharing this unique and informative post. This blog which provided me the required information. Data Science Training in Chennai | Java Training in Chennai
ReplyDeleteHi, you have given really informative post. Thanks for sharing this post to our vision. Learn Python will helps you to reach your goal.
ReplyDeletePython Training in Marathahalli
Dot Net Training in Chennai
It is a long established fact that a reader will be distracted by the readable content of a page when looking at its layout.
ReplyDeleteNice blog. Thank you for sharing. The information you shared is very effective for learners I have got some important suggestions from it.
ReplyDeleteWeb Designing Training Institute in Chennai | DotNet Training Institute in Chennai | Java Training Institute in Chennai
Needed to compose you a very little word to thank you yet again regarding the nice suggestions you’ve contributed here.
ReplyDeleteData Science Training in Bangalore
Datascience Training in Chennai
Thanks for your marvelous posting! It is very useful and good. Come on. I want to introduce the best aso services for you, I try it and I feel it is so good to rank app to top in app store search results, have you ever heard it?
ReplyDeletePreparation as well as organization tend to be chief elements to facilitate an excellent camping journey. You must be sure you are totally prepared prior to going camping.mortgage broker bc
ReplyDeleteI am very glad to see such a great blog, Its so creative. Keep ongoing such a informative blog..RPA Training Institute in Chennai | UI Path Training Institute in Chennai | Blue Prism Training Institute in Chennai
ReplyDeleteI really understand your post..Thanks for sharing valuable post..
ReplyDeleteNo.1 Software Testing Training Institute in Chennai | Best Selenium Training Institute in Chennai | ISTQB Certification Center in Velachery
ReplyDeleteCytotec obat aborsi
Jual obat aborsi murah
Jual obat aborsi bandung
Jual obat aborsi batam
Jual obat aborsi makassar
Jual obat aborsi malang
ReplyDeleteJual obat aborsi surabaya
Jual obat aborsi palembang
Jual obat aborsi semarang
Jual obat aborsi jakarta
Jual obat aborsi bekasi
Cara menggugurkan kandungan
I have a undertaking that I’m just now working on, and I’ve been at the look out for such information.golf short game
ReplyDeletePLC Training in Chennai | PLC Training Institute in Chennai | PLC Training Center in Chennai | PLC SCADA Training in Chennai | PLC SCADA DCS Training in Chennai | Best PLC Training in Chennai | Best PLC Training Institute in Chennai | PLC Training Centre in Chennai | PLC SCADA Training in Chennai | Automation Training Institute in Chennai | PLC Training in Kerala
ReplyDeleteother countries who are oppressed and it just shouldn’t be that way. Every woman should have the opportunity to be who she wants to be and do what she wants to do! moving miami fl
ReplyDeleteExcellent and decent post. I found this much informative, as to what I was exactly searching for. Thanks for such post and please keep it up. wrongful termination
ReplyDeleteNice Blog
ReplyDeletedata science training in bangalore
powershell training in bangalore
gst training in bangalore
web designing training in bangalore
Machine Learning training in bangalore
nice blog
ReplyDeleteandroid training in bangalore
ios training in bangalore
Spirit made this morning? thank you for providing information that is so interesting and useful سيارة بورش
ReplyDeleteNice blog
ReplyDeletedata science training in bangalore.html
devops training in bangalore
python training in bangalore
aws training in bangalore
data science training in bangalore.html
ReplyDeleteReally wonderful post.Thanks for sharing such an informative post to our knowledge...
ReplyDeleteGood Technical Boot Camp in Chennai | Summer Course in Porur
wow really superb you had posted one nice information through this. Definitely it will be useful for many people. So please keep update like this.
ReplyDeleteBest Summer Courses for Hardware Networking in Chennai | No.1 Summer Course in Guindy
I really enjoyed while reading your article. The information you have delivered in this post was damn good. Keep sharing your post with efficient news. No.1 CorelDraw Summer Course in Guindy | Perfect Vacation Classes in Chennai
ReplyDeleteA veteran educator has compiled her most-requested homeschooling workshop material so that families can become more proficient in educating their kids. gildan heavy cotton
ReplyDeleteI strongly believe that there will be great opportunities for those who looked into this area, thanks much for creating and sharing here...
ReplyDeletePhotoshop Training Institute in Chennai | Best Multimedia Training Institute in Velachery
The information shared was very much useful My sincere thanks for sharing this post Please Continue to share this post... Graphics Designing Training Institute in chennai | Best Multimedia courses in Velachery
ReplyDeleteThis information is very useful. thank you for sharing. and I will also share information about SBN mystery through the website...
ReplyDeleteGood AWS Training in Tambaram | AWS Courses in Adyar | AWS Institute in Besant Nagar
The best thing is that your blog really informative thanks for your great information!
ReplyDeleteAWS Certification Exam Centers in Taramani | AWS Training in Shozhinganallur
One of the most important thing about Blog Comment is, It through you can get wide knowledge of every field.
ReplyDeleteCorelDraw Certification Training in Chennai | Advance CorelDraw Training in Madipakkam
I decided to browse your site on my lap during break. I love the information you provide here thanks a lot keep rocking..
ReplyDeleteAndroid Exam Certification Training in Chennai | No.1 Android Exam in Velachery
Very happy to see this blog. Gives a wonderful information with coded explanation. Thank you for this blog. very useful to me. Hardware and Networking Certification Center in Chennai | No.1 Hardware Exam in Medavakkam
ReplyDeleteThanks for sharing this informative content that guided me to know the details about the training offered in different technology.
ReplyDeleteCertified Ethical Hacking Training in Chennai | No.1 Ethical Hacking in Porur
Nice Blog. Thank you for Sharing the great information!
ReplyDeleteCisco Certification Training in Chennai | Excellent Cisco Courses in Pallavaram
Thank you Admin!
ReplyDelete1 crore projects center specializes in Robotics Training in chennai
Very nice post. Thanks for your sharing such a wonderful post.
ReplyDeleteweb design training in chennai | web development training in chennai
Awesome post!
ReplyDeleteThanks.You can learn best Advance Java Training in Chennai | Arduino Training in chenna
Once you are well-informed about the real estate market and the selling process, selling your own home will become less stressful. Knowing how to navigate your way through this process is a wonderful skill.Resin Bound
ReplyDeleteYour good knowledge and kindness in playing with all the pieces were
ReplyDeletevery useful. Python Certifications Exams in Chennai | Perfect Python Coaching in Mandaveli
Excellent article. The information you shared is very effective for learners I have got some important suggestions from it, Keep on going...
ReplyDeleteISTQB Certifications Exam Cost in Chennai | QA Testing in Thiruvanmiyur
Great one,You have done a great job by sharing this content,Thank you a lot for providing individuals with a very spectacular possibility to read critical reviews from this site.
ReplyDeletePython Training in Chennai
Python Training
I believe there are many more pleasurable opportunities ahead for individuals that looked at your site.
ReplyDeleteJava Project Center in Chennai | No.1 Java Project Training in Porur
Nice post. It was really effective. Thank you for sharing.
ReplyDeleteVLSI Project Center Training in Chennai | Best VLSI Project Course in Alandur
You have done really a great job by sharing this blog here. Keep writing blog like this.
ReplyDeleteEmbedded Project Center Training in Chennai | Best Embedded Project Course in Adambakkam
Great post and informative blog.it was awesome to read, thanks for sharing this great content to my vision.
ReplyDeleteGood discussion.
Six Sigma Training in Abu Dhabi
Six Sigma Training in Dammam
Six Sigma Training in Riyadh
Great post and informative blog.it was awesome to read, thanks for sharing this great content to my vision.
ReplyDeleteGood discussion.
PMP Training Course in Bangalore
PMP Training Course in Dammam
PMP Training Course in Dubai
PMP Training Course in Jeddah
PMP Training Course in Riyadh
Great Article… I love to read your articles because your writing style is too good, its is very very helpful for all of us. Do check Six Sigma Training in Bangalore | Six Sigma Training in Dubai
ReplyDelete& Get trained by an expert who will enrich you with the latest trends.
Amazing read, thanks for helping me out! Download clone hero best songs from: clone hero charts
ReplyDeleteNice blog
ReplyDeletebest android training center in Marathahalli
best android development institute in Marathahalli
android training institutes in Marathahalli
ios training in Marathahalli
android training in Marathahalli
mobile app development training in Marathahalli
Nice Blog
ReplyDeletedevops course in bangalore
best devops training in bangalore
Devops certification training in bangalore
devops training in bangalore
devops training institute in bangalore
Nice post..
ReplyDeleteaws course in BTM
aws training center in BTM
cloud computing courses in BTM
amazon web services training institutes in BTM
best cloud computing institute in BTM
cloud computing training in btm
aws training in btm
aws certification in btm
best aws training in btm
aws certification training in btm
Nice post..
ReplyDeletesalesforce training in btm
salesforce admin training in btm
salesforce developer training in btm
Nice Post
ReplyDeleteaws course in Bangalore
aws training center in Bangalore
cloud computing courses in Bangalore
amazon web services training institutes in Bangalore
best cloud computing institute in Bangalore
cloud computing training in Bangalore
aws training in Bangalore
aws certification in Bangalore
best aws training in Bangalore
aws certification training in Bangalore
amazing blog
ReplyDeleterobotics courses in Bangalore
robotic process automation training in Bangalore
blue prism training in Bangalore
rpa training in Bangalore
automation anywhere training in Bangalore
Amazing read, thanks for helping me out!
ReplyDeleteDOT NET training in Marathahalli
dot net training institute in Marathahalli
dot net course in Marathahalli
best dot net training institute in Marathahalli
Really wonderful post.Thanks for sharing
ReplyDeletejava training in Marathahalli
spring training in Marathahalli
java training institute in Marathahalli
spring and hibernate training in Marathahalli
Nice post..
ReplyDeletepython django training in BTM
python training centers in BTM
python scripting classes in BTM
python certification course in BTM
python training courses in BTM
python institutes in BTM
python training in btm
python course in btm
best python training institute in btm
Very nice post here, keep sharing.
ReplyDeleteData Science Course in Chennai
Data Analytics Courses in Chennai
AWS course in Chennai
Angular 6 Training in Chennai
RPA Training in Chennai
RPA course in Chennai
Thank you very much for posting and sharing this great article. It is so interesting. I want to know some other information about this site.commercial pest control
ReplyDeleteGreat post and informative blog.it was awesome to read, thanks for sharing this great content to my vision.
ReplyDeletePHP Final Year Project Center in Chennai | PHP Project in Chromepet
Do not pass by, go to the online casino and try your luck best casino slot Do you like to play online casino? Then come to us and win like the last day.
ReplyDeleteThank you for this wonderful post! I am glad that I came across your article. Looking forward to learn more from your article.
ReplyDeleteTally Course in Chennai
Tally Training in Chennai
Ionic Training in Chennai
Spark Training in Chennai
Excel Training in Chennai
VMware Training in Chennai
Microsoft Dynamics CRM Training in Chennai
Embedded Training in Chennai
Its is good and very informative.
ReplyDeleteRegards,
Data Science Course In Chennai
Wonderful Blog. Keep Posting.
ReplyDeleteAdvanced Excel Training in Chennai
Corporate Excel Training in Mumbai
Best Advanced Excel Training in bangalore
Power BI Training in Chennai
Neat and fruitful presentation!! I thouroughly enjoyed your article. I was searching the post like you wrote. Thanks for your sharing!!
ReplyDeletePHP Training in Chennai
PHP Course in Chennai
German Language Classes in Chennai
Big Data Course in Chennai
Advanced Java Training in Chennai
PHP Training in Porur
PHP Training in Adyar
Big Data Training in Chennai
Качественный декоративный алюминиевый led профиль я обычно беру в компании Ekodio, советую.
ReplyDeleteThank you for excellent article.
ReplyDeletePlease refer below if you are looking for best project center in coimbatore
soft skill training in coimbatore
final year projects in coimbatore
Spoken English Training in coimbatore
final year projects for CSE in coimbatore
final year projects for IT in coimbatore
final year projects for ECE in coimbatore
final year projects for EEE in coimbatore
final year projects for Mechanical in coimbatore
final year projects for Instrumentation in coimbatore
Happy to read your blog and gained a lot of new information in detail. Thanks for sharing.
ReplyDeleteIELTS Coaching in Chennai
IELTS Coaching Centre in Chennai
IELTS Training in Chennai
Best IELTS Coaching in Chennai
IELTS Classes in Mumbai
IELTS Coaching in Mumbai
Best IELTS Coaching in Mumbai
IELTS Center in Mumbai
The blog which you have shared is more informative. thanks for your sharing...
ReplyDeleteGerman Classes in Bangalore
German Language Course in Bangalore
German Language Course in Madurai
German Classes in Coimbatore
German Language course in Coimbatore
RPA training in bangalore
Selenium Training in Bangalore
Java Training in Madurai
Oracle Training in Coimbatore
PHP Training in Coimbatore
today damn all day stay on this site fancy online gambling games for real money There are so many cool game machines and all sorts of other gambling games I will say one thing to have fun here
ReplyDeleteVery awesome post, thank you for sharing...
ReplyDeletedata science course malaysia
data science course
https://excelr.com.my/course/certification-program-in-data-science/
nice blog, thank you for sharing ...
ReplyDeletehttps://excelr.com.my/course/certification-program-in-data-science/
great Article, thank you for such an useful info.
ReplyDeletehttps://excelr.com.my/course/certification-program-in-data-science/
awesome blog , thank you.
ReplyDeletepmp certification
project management certification
project management courses
project management training
https://excelr.com.my/course/project-management-professional-pmp/
You are doing a great job. I would like to appreciate your work for good accuracy
ReplyDeleteData Science Course in Chennai
Data Science With R Training
Python Training in Chennai
Machine Learning in Chennai
SAS Training in Chennai
awesome article, great content thank you.
ReplyDeleteindustry 4.0
iot industry 4.0
industri 4.0
https://excelr.com.my/course/certification-on-industrial-revolution-4-0/