Towards Fair Classifiers Without Sensitive Attributes Exploring Biases in Related Features. Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their adoption on high stake applications. Thus, many efforts have been taken for developing fair machine learning models. Most of them require that sensitive attributes are available during training to learn fair models. However, in many real world applications, it is usually infeasible to obtain the sensitive attributes due to privacy or legal issues, which challenges existing fair ensuring strategies. Though the sensitive attribute of each data sample is unknown, we observe that there are usually some non sensitive features in the training data that are highly correlated with sensitive attributes, which can be used to alleviate the bias. Therefore, in this paper, we study a novel problem of exploring features that are highly correlated with sensitive attributes for learning fair and accurate classifiers. We theoretically show that by minimizing the correlation between these related features and model prediction, we can learn a fair classifier. Based on this motivation, we propose a novel framework which simultaneously uses these related features for accurate prediction and enforces fairness. In addition, the model can dynamically adjust the regularization weight of each related feature to balance its contribution on model classification and fairness. Experimental results on real world datasets demonstrate the effectiveness of the proposed model for learning fair models with high classification accuracy.


A Bayesian Approach for Inferring Sea Ice Loads. The Earth's climate is rapidly changing and some of the most drastic changes can be seen in the Arctic, where sea ice extent has diminished considerably in recent years. As the Arctic climate continues to change, gathering in situ sea ice measurements is increasingly important for understanding the complex evolution of the Arctic ice pack. To date, observations of ice stresses in the Arctic have been spatially and temporally sparse. We propose a measurement framework that would instrument existing sea ice buoys with strain gauges. This measurement framework uses a Bayesian inference approach to infer ice loads acting on the buoy from a set of strain gauge measurements. To test our framework, strain measurements were collected from an experiment where a buoy was frozen into ice that was subsequently compressed to simulate convergent sea ice conditions. A linear elastic finite element model was used to describe the response of the deformable buoy to mechanical loading, allowing us to link the observed strain on the buoy interior to the applied load on the buoy exterior. The approach presented in this paper presents an instrumentation framework that could use existing buoy platforms as in situ sensors of internal stresses in the ice pack.


Cohomology rings of quasitoric bundles. The classical BKK theorem computes the intersection number of divisors on toric variety in terms of volumes of corresponding polytopes. It was observed by Pukhlikov and the first author that the BKK theorem leads to a presentation of the cohomology ring of toric variety as a quotient of the ring of differential operators with constant coefficients by the annihilator of an explicit polynomial. In this paper we generalize this construction to the case of quasitoric bundles. These are fiber bundles with generalized quasitoric manifolds as fibers. First we obtain a generalization of the BKK theorem to this case. Then we use recently obtained descriptions of the graded commutative algebras which satisfy Poincar 'e duality to give a description of cohomology rings of quasitoric bundles.


Anticanonically balanced metrics and the Hilbert Mumford criterion for the delta m invariant of Fujita Odaka. We prove that the stability condition for Fano manifolds defined by Saito Takahashi, given in terms of the sum of the Ding invariant and the Chow weight, is equivalent to the existence of anticanonically balanced metrics. Combined with the result by Rubinstein Tian Zhang, we obtain the following algebro geometric corollary the delta m invariant of Fujita Odaka satisfies delta m 1 if and only if the Fano manifold is stable in the sense of Saito Takahashi, establishing a Hilbert Mumford type criterion for delta m 1 . We also extend this result to the K "ahler Ricci g solitons and the coupled K "ahler Einstein metrics, and as a by product we obtain a formula for the asymptotic slope of the coupled Ding functional in terms of multiple test configurations.


An Effective and Robust Detector for Logo Detection. In recent years, intellectual property (IP), which represents literary, inventions, artistic works, etc, gradually attract more and more people's attention. Particularly, with the rise of e commerce, the IP not only represents the product design and brands, but also represents the images videos displayed on e commerce platforms. Unfortunately, some attackers adopt some adversarial methods to fool the well trained logo detection model for infringement. To overcome this problem, a novel logo detector based on the mechanism of looking and thinking twice is proposed in this paper for robust logo detection. The proposed detector is different from other mainstream detectors, which can effectively detect small objects, long tail objects, and is robust to adversarial images. In detail, we extend detectoRS algorithm to a cascade schema with an equalization loss function, multi scale transformations, and adversarial data augmentation. A series of experimental results have shown that the proposed method can effectively improve the robustness of the detection model. Moreover, we have applied the proposed methods to competition ACM MM2021 Robust Logo Detection that is organized by Alibaba on the Tianchi platform and won top 2 in 36489 teams. Code is available at https github.com jiaxiaojunQAQ Robust Logo Detection.


The Core Conjecture of Hilton and Zhao II a Proof. A simple graph G with maximum degree Delta is overfull if E(G) Delta lfloor V(G) 2 rfloor . The core of G , denoted G Delta , is the subgraph of G induced by its vertices of degree Delta . Clearly, the chromatic index of G equals Delta 1 if G is overfull. Conversely, Hilton and Zhao in 1996 conjectured that if G is a simple connected graph with Delta ge 3 and Delta(G Delta) le 2 , then chi'(G) Delta 1 implies that G is overfull or G P , where P is obtained from the Petersen graph by deleting a vertex. Cariolaro and Cariolaro settled the base case Delta 3 in 2003, and Cranston and Rabern proved the next case Delta 4 in 2019. In this paper, we give a proof of this conjecture for all Delta ge 4 .


Incompatible bounded category forcing axioms. We introduce bounded category forcing axioms for well behaved classes Gamma . These are strong forms of bounded forcing axioms which completely decide the theory of some initial segment of the universe H lambda Gamma modulo forcing in Gamma , for some cardinal lambda Gamma naturally associated to Gamma . These axioms naturally extend projective absoluteness for arbitrary set forcing in this situation lambda Gamma omega to classes Gamma with lambda Gamma omega . Unlike projective absoluteness, these higher bounded category forcing axioms do not follow from large cardinal axioms, but can be forced under mild large cardinal assumptions on V . We also show the existence of many classes Gamma with lambda Gamma omega 1 , and giving rise to pairwise incompatible theories for H omega 2 .


Embedding surfaces inside small domains with minimal distortion. Given two dimensional Riemannian manifolds mathcal M , mathcal N , we prove a lower bound on the distortion of embeddings mathcal M to mathcal N , in terms of the areas' discrepancy V mathcal N V mathcal M , for a certain class of distortion functionals. For V mathcal N V mathcal M ge 1 4 , homotheties, provided they exist, are the unique energy minimizing maps attaining the bound, while for V mathcal N V mathcal M le 1 4 , there are non homothetic minimizers. We characterize the maps attaining the bound, and construct explicit non homothetic minimizers between disks. We then prove stability results for the two regimes. We end by analyzing other families of distortion functionals. In particular we characterize a family of functionals where no phase transition in the minimizers occurs homotheties are the energy minimizers for all values of V mathcal N V mathcal M , provided they exist.


Generalized dynamic cognitive hierarchy models for strategic driving behavior. While there has been an increasing focus on the use of game theoretic models for autonomous driving, empirical evidence shows that there are still open questions around dealing with the challenges of common knowledge assumptions as well as modeling bounded rationality. To address some of these practical challenges, we develop a framework of generalized dynamic cognitive hierarchy for both modelling naturalistic human driving behavior as well as behavior planning for autonomous vehicles (AV). This framework is built upon a rich model of level 0 behavior through the use of automata strategies, an interpretable notion of bounded rationality through safety and maneuver satisficing, and a robust response for planning. Based on evaluation on two large naturalistic datasets as well as simulation of critical traffic scenarios, we show that i) automata strategies are well suited for level 0 behavior in a dynamic level k framework, and ii) the proposed robust response to a heterogeneous population of strategic and non strategic reasoners can be an effective approach for game theoretic planning in AV.


cs.CE math.DS physics.comp-ph physics.flu-dyn

Efficient split step schemes for fluid structure interaction involving incompressible generalised Newtonian flows. Blood flow, dam or ship construction and numerous other problems in biomedical and general engineering involve incompressible flows interacting with elastic structures. Such interactions heavily influence the deformation and stress states which, in turn, affect the engineering design process. Therefore, any reliable model of such physical processes must consider the coupling of fluids and solids. However, complexity increases for non Newtonian fluid models, as used, e.g., for blood or polymer flows. In these fluids, subtle differences in the local shear rate can have a drastic impact on the flow and hence on the coupled problem. There, existing (semi )implicit solution strategies based on split step or projection schemes for Newtonian fluids are not applicable, while extensions to non Newtonian fluids can lead to substantial numerical overhead depending on the chosen fluid solver. To address these shortcomings, we present here a higher order accurate, added mass stable fluid structure interaction scheme centered around a split step fluid solver. We compare several implicit and semi implicit variants of the algorithm and verify convergence in space and time. Numerical examples show good performance in both benchmarks and an idealised setting of blood flow through an abdominal aortic aneurysm considering physiological parameters.


ZERO Playing Mathematical Programming Games. We present ZERO, a modular and extensible C library interfacing Mathematical Programming and Game Theory. ZERO provides a comprehensive toolkit of modeling interfaces and algorithms for Reciprocally Bilinear Games (RBGs), i.e., simultaneous non cooperative games where each player solves a mathematical program with a linear objective in the player's variable and bilinear in its opponents' variables. This class of games generalizes the classical problems of Operations Research to a multi agent setting. ZERO modular structure gives users all the elementary ingredients to design new game theoretic models and algorithms for RBGs, and find their Nash equilibria. The library provides additional extended support for integer non convexities, linear bilevel problems, and linear equilibrium problems with equilibrium constraints. We provide an overview of the software's key components and showcase a Knapsack Game, i.e., a game where each player solves a binary knapsack problem. Aiming to boost practical methodological contributions at the interplay of Mathematical Programming and Game Theory, we release ZERO as open source software. Source code, documentation and examples are available at www.getzero.one.


Long Short Transformer Efficient Transformers for Language and Vision. Transformers have achieved success in both language and vision domains. However, it is prohibitively expensive to scale them to long sequences such as long documents or high resolution images, because self attention mechanism has quadratic time and memory complexities with respect to the input sequence length. In this paper, we propose Long Short Transformer (Transformer LS), an efficient self attention mechanism for modeling long sequences with linear complexity for both language and vision tasks. It aggregates a novel long range attention with dynamic projection to model distant correlations and a short term attention to capture fine grained local correlations. We propose a dual normalization strategy to account for the scale mismatch between the two attention mechanisms. Transformer LS can be applied to both autoregressive and bidirectional models without additional complexity. Our method outperforms the state of the art models on multiple tasks in language and vision domains, including the Long Range Arena benchmark, autoregressive language modeling, and ImageNet classification. For instance, Transformer LS achieves 0.97 test BPC on enwik8 using half the number of parameters than previous method, while being faster and is able to handle 3x as long sequences compared to its full attention version on the same hardware. On ImageNet, it can obtain the state of the art results (e.g., a moderate size of 55.8M model solely trained on 224x224 ImageNet 1K can obtain Top 1 accuracy 84.1 ), while being more scalable on high resolution images. The source code and models are released at https github.com NVIDIA transformer ls .


Finite Coxeter Groups and Generalized ElnitskyTilings. In 1993, Elnitsky constructed three elegant bijections between classes of reduced words for Type A, B and D families of Coxeter groups and certain tilings of polygons. This paper offers a particular generalisation of this concept to all finite Coxeter Groups in terms of embeddings into the Symmetric Group. A natural subset of these embeddings are shown to be Bruhat preserving maps.


Advancing Artificial Intelligence and Machine Learning in the U.S. Government Through Improved Public Competitions. In the last two years, the U.S. government has emphasized the importance of accelerating artificial intelligence (AI) and machine learning (ML) within the government and across the nation. In particular, the National Artificial Intelligence Initiative Act of 2020, which became law on January 1, 2021, provides for a coordinated program across the entire federal government to accelerate AI research and application. The U.S. government can benefit from public artificial intelligence and machine learning challenges through the development of novel algorithms and participation in experiential training. Although the public, private, and non profit sectors have a history of leveraging crowdsourcing initiatives to generate novel solutions to difficult problems and engage stakeholders, interest in public competitions has waned in recent years as a result of at least three major factors (1) a lack of high quality, high impact data (2) a narrow engagement focus on specialized groups and (3) insufficient operationalization of challenge results. Herein we identify common issues and recommend approaches to increase the effectiveness of challenges. To address these barriers, enabling the use of public competitions for accelerating AI and ML practice, the U.S. government must leverage methods that protect sensitive data while enabling modelling, enable easier participation, empower deployment of validated models, and incentivize engagement from broad sections of the population.


Centralizers of Rank One in the First Weyl Algebra. Centralizers of rank one in the first Weyl algebra have genus zero.


Linear stability of the Couette flow for the non isentropic compressible fluid. We are concerned with the linear stability of the Couette flow for the non isentropic compressible Navier Stokes equations with vanished shear viscosity in a domain mathbb T times mathbb R . For a general initial data settled in Sobolev spaces, we obtain a Lyapunov type instability of the density, the temperature, the compressible part of the velocity field, and also obtain an inviscid damping for the incompressible part of the velocity field. Moreover, if the initial density, the initial temperature and the incompressible part of the initial velocity field satisfy some quality relation, we can prove the enhanced dissipation phenomenon for the velocity field.


Compact freeform illumination design by deblurring the extended sources. Illumination is the deliberate utilization of light to realize practical or aesthetic effects. The designers combine with the environmental considerations, energy saving goals, and technology advances with fundamental physics to develop lighting solutions to satisfy all of our ever changing needs. Achieving highly efficient and precise control of the energy output of light sources while maintaining compact optical structures is the ultimate goal of illumination design. To realize miniaturized and lightweight luminaires, the design process must consider the extents of light sources. However, the illumination design for extended sources is still a challenging and unsolved problem. Here, we propose a method to design ultra performance illumination optics enabled by freeform optical surfaces. The proposed method is very general with no limitations of far field approximation and Lambertian luminescent property. We demonstrate the feasibility and efficiency of the proposed method by designing several freeform lenses realizing accurate and highly efficient illumination control as well as ultra compact structures.


Optical imaging and tracking of single molecules in ultrahigh vacuum. Molecule surface interaction is key to many physical and chemical processes at interfaces. Here, we show that the dynamics of single molecules on a surface under ultrahigh vacuum can be resolved using fluorescence imaging. By adapting oil immersion microscopy to a thin vacuum window, we measure the surface adsorption, translational and rotational diffusion of single perylene molecules on a fused silica surface with high spatial and temporal resolutions. Time dependent measurements of the fluorescence signal allow us to deduce two characteristic decay time scales, which can be explained through a simplified model involving two adsorption states and five energy levels. The system presented in this work combines fluorescence imaging with essential ingredients for surface science and promises a platform for probing single molecule surface interactions in highly defined conditions.


On the computational complexity of the Steiner k eccentricity. The Steiner k eccentricity of a vertex v of a graph G is the maximum Steiner distance over all k subsets of V (G) which contain v . A linear time algorithm for calculating the Steiner k eccentricity of a vertex on block graphs is presented. For general graphs, an O(n nu(G) 1 (n(G) m(G) k)) algorithm is designed, where nu(G) is the cyclomatic number of G . A linear algorithm for computing the Steiner 3 eccentricities of all vertices of a tree is also presented which improves the quadratic algorithm from Discrete Appl. Math. 304 (2021) 181 195 .


Stability of the log Brunn Minkowski inequality in the case of many hyperplane symmetries. In the case of symmetries with respect to n independent linear hyperplanes, a stability version of the logarithmic Brunn Minkowski inequality and the logarithmic Minkowski inequality for convex bodies is established.


Nonconvex Nonconcave Min Max Optimization with a Small Maximization Domain. We study the problem of finding approximate first order stationary points in optimization problems of the form min x in X max y in Y f(x,y) , where the sets X,Y are convex and Y is compact. The objective function f is smooth, but assumed neither convex in x nor concave in y . Our approach relies upon replacing the function f(x, cdot) with its k th order Taylor approximation (in y ) and finding a near stationary point in the resulting surrogate problem. To guarantee its success, we establish the following result let the Euclidean diameter of Y be small in terms of the target accuracy varepsilon , namely O( varepsilon frac 2 k 1 ) for k in mathbb N and O( varepsilon) for k 0 , with the constant factors controlled by certain regularity parameters of f then any varepsilon stationary point in the surrogate problem remains O( varepsilon) stationary for the initial problem. Moreover, we show that these upper bounds are nearly optimal the aforementioned reduction provably fails when the diameter of Y is larger. For 0 le k le 2 the surrogate function can be efficiently maximized in y our general approximation result then leads to efficient algorithms for finding a near stationary point in nonconvex nonconcave min max problems, for which we also provide convergence guarantees.


Topology Optimization with linearized buckling criteria in 250 lines of Matlab. We present a 250 line Matlab code for topology optimization for linearized buckling criteria. The code is conceived to handle stiffness, volume and Buckling Load Factors (BLFs) either as the objective function or as constraints. We use the Kreisselmeier Steinhauser aggregation function in order to reduce multiple objectives (viz. constraints) to a single, differentiable one. Then, the problem is sequentially approximated by using MMA like expansions and an OC like scheme is tailored to update the variables. The inspection of the stress stiffness matrix leads to a vectorized implementation for its efficient construction and for the sensitivity analysis of the BLFs. This, coupled with the efficiency improvements already presented by Ferrari and Sigmund 2020, cuts all the computational bottlenecks associated with setting up the buckling analysis and allows buckling topology optimization problems of an interesting size to be solved on a laptop. The efficiency and flexibility of the code is demonstrated over a few structural design examples and some ideas are given for possible extensions.


Smart Cities Potentialities and Challenges in a Context of Sharing Economy. The purpose of the present paper is to show how blockchain and IoT technologies can benefit smart city projects, which tend to spread in the context of the sharing economy. The article also aims to describe the challenges and potentialities of smart city projects. It was found that technology platforms can serve as a strategy to build the basis for product development (goods and services) and technology based innovation.


C ast extreme maps and nests. The generalized state space S mathcal H ( mathcal mathcal A ) of all unital completely positive (UCP) maps on a unital C algebra mathcal A taking values in the algebra mathcal B ( mathcal H ) of all bounded operators on a Hilbert space mathcal H , is a C ast convex set. In this paper, we establish a connection between C ast extreme points of S mathcal H ( mathcal A ) and a factorization property of certain algebras associated to the UCP map. In particular, this factorization property of some nest algebras is used to give a complete characterization of those C ast extreme maps which are direct sums of pure UCP maps. This significantly extends a result of Farenick and Zhou Proc. Amer. Math. Soc. 126 (1998) from finite to infinite dimensional Hilbert spaces. Also it is shown that normal C ast extreme maps on type I factors are direct sums of normal pure UCP maps if and only if an associated algebra is reflexive. Further, a Krein Milman type theorem is established for C ast convexity of the set S mathcal H ( mathcal A ) equipped with bounded weak topology, whenever mathcal A is a separable C ast algebra or it is a type I factor. As an application, we provide a new proof of a classical factorization result on operator valued Hardy algebras.


Interpretable Reinforcement Learning Inspired by Piaget's Theory of Cognitive Development. Endeavors for designing robots with human level cognitive abilities have led to different categories of learning machines. According to Skinner's theory, reinforcement learning (RL) plays a key role in human intuition and cognition. Majority of the state of the art methods including deep RL algorithms are strongly influenced by the connectionist viewpoint. Such algorithms can significantly benefit from theories of mind and learning in other disciplines. This paper entertains the idea that theories such as language of thought hypothesis (LOTH), script theory, and Piaget's cognitive development theory provide complementary approaches, which will enrich the RL field. Following this line of thinking, a general computational building block is proposed for Piaget's schema theory that supports the notions of productivity, systematicity, and inferential coherence as described by Fodor in contrast with the connectionism theory. Abstraction in the proposed method is completely upon the system itself and is not externally constrained by any predefined architecture. The whole process matches the Neisser's perceptual cycle model. Performed experiments on three typical control problems followed by behavioral analysis confirm the interpretability of the proposed method and its competitiveness compared to the state of the art algorithms. Hence, the proposed framework can be viewed as a step towards achieving human like cognition in artificial intelligent systems.


Cylinders' percolation decoupling and applications. In this paper we establish a strong decoupling inequality for the cylinder's percolation process introduced by Tykesson and Windisch in arXiv 1010.5338 . This model features a very strong dependency structure, making it difficult to study, and this is why such decoupling inequalities are desirable. It is important to notice that the type of dependencies featured by cylinder's percolation is particularly intricate, given that the cylinders have infinite range (unlike some models like Boolean percolation) while at the same time being rigid bodies (unlike processes such as Random Interlacements). Our work introduces a new notion of fast decoupling, proves that it holds for the model in question and finishes with an application. More precisely, we prove that for a small enough density of cylinders, a random walk on a connected component of the vacant set is transient for all dimensions d geq 3 .


Point Enclosure Problem for Homothetic Polygons. In this paper, we investigate the homothetic point enclosure problem given a set S of n triangles with sides parallel to three fixed directions, find a data structure for S that can report all the triangles of S that contain a query point efficiently. The problem is "inverse" of the homothetic range search problem. We present an O(n log n) space solution that supports the queries in O( log n k) time, where k is the output size. The preprocessing time is O(n log n) . The same results also hold for homothetic polygons.


Best of Both Worlds Fair Share Allocations. We consider the problem of fair allocation of indivisible items among n agents with additive valuations, when agents have equal entitlements to the goods, and there are no transfers. Best of Both Worlds (BoBW) fairness mechanisms aim to give all agents both an ex ante guarantee (such as getting the proportional share in expectation) and an ex post guarantee. Prior BoBW results have focused on ex post guarantees that are based on the "up to one item" paradigm, such as envy free up to one item (EF1). In this work we attempt to give every agent a high value ex post, and specifically, a constant fraction of his maximin share (MMS). The up to one item paradigm fails to give such a guarantee, and it is not difficult to present examples in which previous BoBW mechanisms give agents only a frac 1 n fraction of their MMS. Our main result is a deterministic polynomial time algorithm that computes a distribution over allocations that is ex ante proportional, and ex post, every allocation gives every agent at least his proportional share up to one item, and more importantly, at least half of his MMS. Moreover, this last ex post guarantee holds even with respect to a more demanding notion of a share, introduced in this paper, that we refer to as the truncated proportional share (TPS). Our guarantees are nearly best possible, in the sense that one cannot guarantee agents more than their proportional share ex ante, and one cannot guarantee agents more than a frac n 2n 1 fraction of their TPS ex post.


Anisotropic Regularity of the Free Boundary Problem in Compressible Ideal Magnetohydrodynamics. We consider 3D free boundary compressible ideal magnetohydrodynamic (MHD) system under the Rayleigh Taylor sign condition. It describes the motion of a free surface perfect conducting fluid in an electro magnetic field. The local well posedness was recently proved by Trakhinin and Wang 66 by using Nash Moser iteration. In this paper, we prove the a priori estimates without loss of regularity for the free boundary compressible MHD system in Lagrangian coordinates in anisotropic Sobolev space, with more regularity tangential to the boundary than in the normal direction. It is based on modified Alinhac good unknowns, which take into account the covariance under the change of coordinates to avoid the derivative loss full utilization of the cancellation structures of MHD system, to turn normal derivatives into tangential ones and delicate analysis in anisotropic Sobolev spaces. Our method is also completely applicable to compressible Euler equations and thus yields an alternative estimate for compressible Euler equations without the analysis of div curl decomposition or the wave equation in Lindblad Luo 42 , that do not work for compressible MHD. To the best of our knowledge, we establish the first result on the energy estimates without loss of regularity for the free boundary problem of compressible ideal MHD.


One Step Preference Elicitation in Multi Objective Bayesian Optimization. We consider a multi objective optimization problem with objective functions that are expensive to evaluate. The decision maker (DM) has unknown preferences, and so the standard approach is to generate an approximation of the Pareto front and let the DM choose from the generated non dominated designs. However, especially for expensive to evaluate problems where the number of designs that can be evaluated is very limited, the true best solution according to the DM's unknown preferences is unlikely to be among the small set of non dominated solutions found, even if these solutions are truly Pareto optimal. We address this issue by using a multi objective Bayesian optimization algorithm and allowing the DM to select a preferred solution from a predicted continuous Pareto front just once before the end of the algorithm rather than selecting a solution after the end. This allows the algorithm to understand the DM's preferences and make a final attempt to identify a more preferred solution. We demonstrate the idea using ParEGO, and show empirically that the found solutions are significantly better in terms of true DM preferences than if the DM would simply pick a solution at the end.


A Bayesian Approach to Reinforcement Learning of Vision Based Vehicular Control. In this paper, we present a state of the art reinforcement learning method for autonomous driving. Our approach employs temporal difference learning in a Bayesian framework to learn vehicle control signals from sensor data. The agent has access to images from a forward facing camera, which are preprocessed to generate semantic segmentation maps. We trained our system using both ground truth and estimated semantic segmentation input. Based on our observations from a large set of experiments, we conclude that training the system on ground truth input data leads to better performance than training the system on estimated input even if estimated input is used for evaluation. The system is trained and evaluated in a realistic simulated urban environment using the CARLA simulator. The simulator also contains a benchmark that allows for comparing to other systems and methods. The required training time of the system is shown to be lower and the performance on the benchmark superior to competing approaches.


Mixed Model OCR Training on Historical Latin Script for Out of the Box Recognition and Finetuning. In order to apply Optical Character Recognition (OCR) to historical printings of Latin script fully automatically, we report on our efforts to construct a widely applicable polyfont recognition model yielding text with a Character Error Rate (CER) around 2 when applied out of the box. Moreover, we show how this model can be further finetuned to specific classes of printings with little manual and computational effort. The mixed or polyfont model is trained on a wide variety of materials, in terms of age (from the 15th to the 19th century), typography (various types of Fraktur and Antiqua), and languages (among others, German, Latin, and French). To optimize the results we combined established techniques of OCR training like pretraining, data augmentation, and voting. In addition, we used various preprocessing methods to enrich the training data and obtain more robust models. We also implemented a two stage approach which first trains on all available, considerably unbalanced data and then refines the output by training on a selected more balanced subset. Evaluations on 29 previously unseen books resulted in a CER of 1.73 , outperforming a widely used standard model with a CER of 2.84 by almost 40 . Training a more specialized model for some unseen Early Modern Latin books starting from our mixed model led to a CER of 1.47 , an improvement of up to 50 compared to training from scratch and up to 30 compared to training from the aforementioned standard model. Our new mixed model is made openly available to the community.


Local Lie n derivations on certain algebras. We prove that each local Lie n derivation is a Lie n derivation under mild assumptions on the unital algebras with a nontrivial idempotent. As applications, we obtain descriptions of local Lie n derivations on generalized matrix algebras, triangular algebras, nest algebras, von Neumann algebras, and the algebras of locally measurable operators affiliated with a von Neumann algebra.


Context aware demand prediction in bike sharing systems incorporating spatial, meteorological and calendrical context. Bike sharing demand is increasing in large cities worldwide. The proper functioning of bike sharing systems is, nevertheless, dependent on a balanced geographical distribution of bicycles throughout a day. In this context, understanding the spatiotemporal distribution of check ins and check outs is key for station balancing and bike relocation initiatives. Still, recent contributions from deep learning and distance based predictors show limited success on forecasting bike sharing demand. This consistent observation is hypothesized to be driven by i) the strong dependence between demand and the meteorological and situational context of stations and ii) the absence of spatial awareness as most predictors are unable to model the effects of high low station load on nearby stations. This work proposes a comprehensive set of new principles to incorporate both historical and prospective sources of spatial, meteorological, situational and calendrical context in predictive models of station demand. To this end, a new recurrent neural network layering composed by serial long short term memory (LSTM) components is proposed with two major contributions i) the feeding of multivariate time series masks produced from historical context data at the input layer, and ii) the time dependent regularization of the forecasted time series using prospective context data. This work further assesses the impact of incorporating different sources of context, showing the relevance of the proposed principles for the community even though not all improvements from the context aware predictors yield statistical significance.


The Faber Krahn inequality for the Short time Fourier transform. In this paper we solve an open problem concerning the characterization of those measurable sets Omega subset mathbb R 2d that, among all sets having a prescribed Lebesgue measure, can trap the largest possible energy fraction in time frequency space, where the energy density of a generic function f in L 2( mathbb R d) is defined in terms of its Short time Fourier transform (STFT) mathcal V f(x, omega) , with Gaussian window. More precisely, given a measurable set Omega subset mathbb R 2d having measure s 0 , we prove that the quantity Phi Omega max Big int Omega mathcal V f(x, omega) 2 ,dxd omega f in L 2( mathbb R d), f L 2 1 Big , is largest possible if and only if Omega is equivalent, up to a negligible set, to a ball of measure s , and in this case we characterize all functions f that achieve equality. This result leads to a sharp uncertainty principle for the "essential support" of the STFT (when d 1 , this can be summarized by the optimal bound Phi Omega leq 1 e Omega , with equality if and only if Omega is a ball). Our approach, using techniques from measure theory after suitably rephrasing the problem in the Fock space, also leads to a local version of Lieb's uncertainty inequality for the STFT in L p when p in 2, infty) , as well as to L p concentration estimates when p in 1, infty) , thus proving a related conjecture. In all cases we identify the corresponding extremals.


Towards Stratified Space Learning Linearly Embedded Graphs. In this paper, we consider the simplest class of stratified spaces linearly embedded graphs. We present an algorithm that learns the abstract structure of an embedded graph and models the specific embedding from a point cloud sampled from it. We use tools and inspiration from computational geometry, algebraic topology, and topological data analysis and prove the correctness of the identified abstract structure under assumptions on the embedding. The algorithm is implemented in the Julia package http github.com yossibokor Skyler.jl , which we used for the numerical simulations in this paper.


Sobolev mappings between RCD spaces and applications to harmonic maps a heat kernel approach. We investigate a Sobolev map f from a finite dimensional RCD space (X, dist X, meas X) to a finite dimensional non collapsed compact RCD space (Y, dist Y, mathcal H N) . If the image f(X) is smooth in a weak sense (which is satisfied if f sharp meas X is absolutely continuous with respect to the Hausdorff measure mathcal H N , or if (Y, dist Y, mathcal H N) is smooth in a weak sense), then the pull back f g Y of the Riemannian metric g Y of (Y, dist Y, mathcal H N) is well defined as an L 1 tensor on X , the minimal weak upper gradient G f of f can be written by using f g Y , and it coincides with the local slope for meas X almost everywhere points in X when f is Lipschitz. In particular the last statement gives a nonlinear analogue of Cheeger's differentiability theorem for Lipschitz functions on metric measure spaces. Moreover these results allow us to define the energy of f . The energy coincides with the Korevaar Schoen energy.In order to achieve this, we use a smoothing of g Y via the heat kernel embedding Phi t Y hookrightarrow L 2(Y, mathcal H N) , which is established by Ambrosio Portegies Tewodrose and the first named author. Moreover we improve the regularity of Phi t , which plays a key role. We show also that (Y, dist Y) is isometric to the N dimensional standard unit sphere in mathbb R N 1 and f is a minimal isometric immersion if and only if (X, dist X, meas X) is non collapsed up to a multiplication of a constant to meas X , and f is an eigenmap whose eigenvalues coincide with the essential dimension of (X, dist X, meas X) , which gives a positive answer to a remaining problem from a previous work by the first named author.


Deep Metric Learning for Open World Semantic Segmentation. Classical close set semantic segmentation networks have limited ability to detect out of distribution (OOD) objects, which is important for safety critical applications such as autonomous driving. Incrementally learning these OOD objects with few annotations is an ideal way to enlarge the knowledge base of the deep learning models. In this paper, we propose an open world semantic segmentation system that includes two modules (1) an open set semantic segmentation module to detect both in distribution and OOD objects. (2) an incremental few shot learning module to gradually incorporate those OOD objects into its existing knowledge base. This open world semantic segmentation system behaves like a human being, which is able to identify OOD objects and gradually learn them with corresponding supervision. We adopt the Deep Metric Learning Network (DMLNet) with contrastive clustering to implement open set semantic segmentation. Compared to other open set semantic segmentation methods, our DMLNet achieves state of the art performance on three challenging open set semantic segmentation datasets without using additional data or generative models. On this basis, two incremental few shot learning methods are further proposed to progressively improve the DMLNet with the annotations of OOD objects.


Single Source One Shot Reenactment using Weighted motion From Paired Feature Points. Image reenactment is a task where the target object in the source image imitates the motion represented in the driving image. One of the most common reenactment tasks is face image animation. The major challenge in the current face reenactment approaches is to distinguish between facial motion and identity. For this reason, the previous models struggle to produce high quality animations if the driving and source identities are different (cross person reenactment). We propose a new (face) reenactment model that learns shape independent motion features in a self supervised setup. The motion is represented using a set of paired feature points extracted from the source and driving images simultaneously. The model is generalised to multiple reenactment tasks including faces and non face objects using only a single source image. The extensive experiments show that the model faithfully transfers the driving motion to the source while retaining the source identity intact.


An ensemble of high rank matrices arising from tournaments. Suppose mathbb F is a field and let mathbf a (a 1, a 2, dotsc) be a sequence of non zero elements in mathbb F . For mathbf a n (a 1, dotsc, a n) , we consider the family mathcal M n( mathbf a ) of n times n symmetric matrices M over mathbb F with all diagonal entries zero and the (i, j) th element of M either a i or a j for i j . In this short paper, we show that all matrices in a certain subclass of mathcal M n( mathbf a ) which can be naturally associated with transitive tournaments have rank at least lfloor 2n 3 rfloor 1 . We also show that if operatorname char ( mathbb F ) neq 2 and M is a matrix chosen uniformly at random from mathcal M n( mathbf a ) , then with high probability operatorname rank (M) geq bigl( frac 1 2 o(1) bigr)n .


Groupoid Actions on Sets, Duality and a Morita Context. Let G and K be groupoids. We present the notion of a (G alpha ,K beta ) set and we prove a duality theorem in this context, which extends the duality theorem for graded algebras by groups. For A a unital G graded algebra and X a finite split G set, we show that there is an isomorphism between the category of the left A modules X graded and the category of the left A alpha G X modules. As an application of this isomorphism, we construct a Morita context.


Between steps Intermediate relaxations between big M and convex hull formulations. This work develops a class of relaxations in between the big M and convex hull formulations of disjunctions, drawing advantages from both. The proposed "P split" formulations split convex additively separable constraints into P partitions and form the convex hull of the partitioned disjuncts. Parameter P represents the trade off of model size vs. relaxation strength. We examine the novel formulations and prove that, under certain assumptions, the relaxations form a hierarchy starting from a big M equivalent and converging to the convex hull. We computationally compare the proposed formulations to big M and convex hull formulations on a test set including K means clustering, P ball problems, and ReLU neural networks. The computational results show that the intermediate P split formulations can form strong outer approximations of the convex hull with fewer variables and constraints than the extended convex hull formulations, giving significant computational advantages over both the big M and convex hull.


Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning. Continual learning (CL) learns a sequence of tasks incrementally with the goal of achieving two main objectives overcoming catastrophic forgetting (CF) and encouraging knowledge transfer (KT) across tasks. However, most existing techniques focus only on overcoming CF and have no mechanism to encourage KT, and thus do not do well in KT. Although several papers have tried to deal with both CF and KT, our experiments show that they suffer from serious CF when the tasks do not have much shared knowledge. Another observation is that most current CL methods do not use pre trained models, but it has been shown that such models can significantly improve the end task performance. For example, in natural language processing, fine tuning a BERT like pre trained language model is one of the most effective approaches. However, for CL, this approach suffers from serious CF. An interesting question is how to make the best use of pre trained models for CL. This paper proposes a novel model called CTR to solve these problems. Our experimental results demonstrate the effectiveness of CTR


Dependent finitely homogneneous rosy structures. We study finitely homogeneous dependent rosy structures, adapting results of Cherlin, Harrington, and Lachlan proved for omega stable omega categorical structures. In particular, we prove that such structures have finite th rank and are coordinatized by a th rank 1 set. We show that they admit a distal, finitely axiomatizable, expansion. These results show that there are, up to inter definability, at most countably many dependent rosy structures M which are homogeneous in a finite relational language.


Propagation and blocking in a two patch reaction diffusion model. This paper is concerned with propagation phenomena for the solutions of the Cauchy problem associated with a two patch one dimensional reaction diffusion model. It is assumed that each patch has a relatively well defined structure which is considered as homogeneous. A coupling interface condition between the two patches is involved. We first study the spreading properties of solutions in the case when the per capita growth rate in each patch is maximal at low densities, a configuration which we call the KPP KPP case, and which turns out to have some analogies with the homogeneous KPP equation in the whole line. Then, in the KPP bistable case, we provide various conditions under which the solutions show different dynamics in the bistable patch, that is, blocking, virtual blocking (propagation with speed zero), or spreading with positive speed. Moreover, when propagation occurs with positive speed, a global stability result is proved. Finally, the analysis in the KPP bistable frame is extended to the bistable bistable case.


Generalized Nearest Neighbor Decoding for MIMO Channels with Imperfect Channel State Information. Information transmission over a multiple input multiple output (MIMO) fading channel with imperfect channel state information (CSI) is investigated, under a new receiver architecture which combines the recently proposed generalized nearest neighbor decoding rule (GNNDR) and a successive procedure in the spirit of successive interference cancellation (SIC). Recognizing that the channel input output relationship is a nonlinear mapping under imperfect CSI, the GNNDR is capable of extracting the information embedded in the joint observation of channel output and imperfect CSI more efficiently than the conventional linear scheme, as revealed by our achievable rate analysis via generalized mutual information (GMI). Numerical results indicate that the proposed scheme achieves performance close to the channel capacity with perfect CSI, and significantly outperforms the conventional pilot assisted scheme, which first estimates the CSI and then uses the estimated CSI as the true one for coherent decoding.


AMALGAM A Matching Approach to fairfy tabuLar data with knowledGe grAph Model. In this paper we present AMALGAM, a matching approach to fairify tabular data with the use of a knowledge graph. The ultimate goal is to provide fast and efficient approach to annotate tabular data with entities from a background knowledge. The approach combines lookup and filtering services combined with text pre processing techniques. Experiments conducted in the context of the 2020 Semantic Web Challenge on Tabular Data to Knowledge Graph Matching with both Column Type Annotation and Cell Type Annotation tasks showed promising results.


Deep Generative Modeling for Protein Design. Deep learning approaches have produced substantial breakthroughs in fields such as image classification and natural language processing and are making rapid inroads in the area of protein design. Many generative models of proteins have been developed that encompass all known protein sequences, model specific protein families, or extrapolate the dynamics of individual proteins. Those generative models can learn protein representations that are often more informative of protein structure and function than hand engineered features. Furthermore, they can be used to quickly propose millions of novel proteins that resemble the native counterparts in terms of expression level, stability, or other attributes. The protein design process can further be guided by discriminative oracles to select candidates with the highest probability of having the desired properties. In this review, we discuss five classes of generative models that have been most successful at modeling proteins and provide a framework for model guided protein design.


A general alternating direction implicit framework with Gaussian process regression parameter prediction for large sparse linear systems. This paper proposes an efficient general alternating direction implicit (GADI) framework for solving large sparse linear systems. The convergence property of the GADI framework is discussed. Most of the existing ADI methods can be viewed as particular schemes of the developed framework. Meanwhile the GADI framework can derive new ADI methods. Moreover, as the algorithm efficiency is sensitive to the splitting parameters, we offer a data driven approach, the Gaussian process regression (GPR) method based on the Bayesian inference, to predict the GADI framework's relatively optimal parameters. The GPR method requires a small training data set to learn the regression prediction mapping, which has sufficient accuracy and high generalization capability. It allows us to efficiently solve linear systems with a one shot computation, and does not require any repeated computations to obtain relatively optimal splitting parameters. Finally, we use the three dimensional convection diffusion equation and continuous Sylvester matrix equation to examine the performance of our proposed methods. Numerical results demonstrate that the proposed framework is faster tens to thousands of times than the existing ADI methods, such as (inexact) Hermitian and skew Hermitian splitting type methods in which the consumption of obtaining relatively optimal splitting parameters is ignored. Due to the efficiency of the developed methods, we can solve much larger linear systems which these existing ADI methods have been not reached.


Imaging properties of large field of view quadratic metalenses and their applications to fingerprint detection. Dielectric metasurfaces, extremely thin nanostructured dielectric surfaces, hold promise to replace conventional refractive optics, such as lenses, due to their high performance and compactness. However, designing large field of view (FOV) metalenses, which are of particular importance when imaging relatively big objects at short distances, remains one of the most critical challenges. Recently, metalenses implementing a quadratic phase profile have been put forward to solve this problem with a single element, but despite their theoretical ability to provide 180 circ , FOV, imaging over very large FOV has not been demonstrated yet. In this work, we provide an in depth analysis of the imaging properties of quadratic metalenses and, in particular, show that due to their intrinsic barrel distortion or fish eye effect, there is a fundamental trade off between the FOV achievable in a given imaging configuration and the optical resolution of the metalens and or the detector resolution. To illustrate how to harness the full potential of quadratic metalenses, we apply these considerations to the fingerprint detection problem, and demonstrate experimentally the full imaging of a 5 , mm fingerprint with features of the order of 100 , mu m, with a metalens ten times smaller in size and located at a distance of only 2.5 , mm away from the object. This constitutes the most compact system reported so far for the fingerprint detection.


A Graphical Based Method for Plotting Local Bifurcation Diagram. Bifurcation diagram is a powerful tool that visually gives information about the behavior of the equilibrium points of a dynamical system respect to the varying parameter. This paper proposes an educational algorithm by which the local bifurcation diagram could be plotted manually and fast in an easy and straightforward way. To the students, this algorithmic method seems to be simpler and more straightforward than mathematical plotting methods in educational and ordinary problems during the learning and studying of courses related to dynamical systems and bifurcation diagrams. For validation, the algorithm has been applied to several educational examples in the course of dynamical systems.


Stochastic Gradient Langevin Dynamics with Variance Reduction. Stochastic gradient Langevin dynamics (SGLD) has gained the attention of optimization researchers due to its global optimization properties. This paper proves an improved convergence property to local minimizers of nonconvex objective functions using SGLD accelerated by variance reductions. Moreover, we prove an ergodicity property of the SGLD scheme, which gives insights on its potential to find global minimizers of nonconvex objectives.


Variational formulation for fractional hyperbolic problems in the theory of viscoelasticity. In this article a theoretical framework for problems involving fractional equations of hyperbolic type arising in the theory of viscoelasticity is presented. Based on the Galerkin method, a variational problem of the fractionary viscoelasticity is studied. An appropriate functional setting is introduced in order to establish the existence, uniqueness and a priori estimates for weak solutions. This framework is developed in close concordance with important physical quantities of the theory of viscoelasticity


Leavitt Path Algebras as Flat Bimorphic Localizations. Refining an idea of Rosenmann and Rosset we show that the now widely studied classical Leavitt algebra L K(1,n) over a field K is a ring of right quotients of the unital free associative algebra of rank n with respect to the perfect Gabriel topology defined by powers of an ideal of codimension 1, providing a conceptual, variable free description of L K(1, n) . This result puts Leavitt (path) algebras on the frontier of important research areas in localization theory, free ideal rings and their automorphism groups, quiver algebras and graph operator algebras. As applications one obtains a short, transparent proof for the module type (1,n) , (n geq 2) of Leavitt algebra L K(1, n) , (n geq 2) , and the fact that Leavitt path algebras of finite graphs are rings of quotients of corresponding ordinary quiver algebras with respect to the perfect Gabriel topology defined by powers of the ideal generated by all arrows and sinks. In particular, the Jacobson algebra of one sided inverses, that is, the Toeplitz algebra, can also be realized as a flat ring of quotients, further illuminating the rich structure of these beautiful, useful algebras.


Functions of class C infty in non commuting variables in the context of triangular Lie algebras. For given triangular real Lie algebra mathfrak g we construct a certain completion C infty mathfrak g of its universal enveloping algebra. It is a Fr 'echet Arens Michael algebra that consists of elements of polynomial growth and satisfies to the following universal property every Lie algebra homomorphism from mathfrak g to a real Banach algebra all of whose elements are of polynomial growth has an extension to a continuous homomorphism from C infty mathfrak g . Elements of this algebra can be called functions of class C infty in non commuting variables. The proof is based on representation theory and uses an ordered C infty functional calculus. Beyond the general case, we analyze two simple examples. As an auxiliary material, we develop the basics of the general theory of algebras of polynomial growth. We also consider local variants of the completion and obtain conditions for existence of a sheaf of non commutative functions on the Gelfand spectrum of C infty mathfrak g . In addition, we discuss the theory of holomorphic functions in non commuting variables introduced by Dosi and apply our methods to prove theorems strengthening some his results.


An Innovative Ecosystem for Accelerator Science and Technology. The emergence of new technologies and innovative communication tools permits us to transcend societal challenges. While particle accelerators are essential instruments to improve our quality of life through science and technology, an adequate ecosystem is essential to activate and maximize this potential. Research Infrastructure (RI) and industries supported by enlightened organizations and education, can generate a sustainable environment to serve this purpose. In this paper, we will discuss state of the art infrastructures taking the lead to reach this impact, thus contributing to economic and social transformation.


Should Graph Neural Networks Use Features, Edges, Or Both?. Graph Neural Networks (GNNs) are the first choice for learning algorithms on graph data. GNNs promise to integrate (i) node features as well as (ii) edge information in an end to end learning algorithm. How does this promise work out practically? In this paper, we study to what extend GNNs are necessary to solve prominent graph classification problems. We find that for graph classification, a GNN is not more than the sum of its parts. We also find that, unlike features, predictions with an edge only model do not always transfer to GNNs.


Font Completion and Manipulation by Cycling Between Multi Modality Representations. Generating font glyphs of consistent style from one or a few reference glyphs, i.e., font completion, is an important task in topographical design. As the problem is more well defined than general image style transfer tasks, thus it has received interest from both vision and machine learning communities. Existing approaches address this problem as a direct image to image translation task. In this work, we innovate to explore the generation of font glyphs as 2D graphic objects with the graph as an intermediate representation, so that more intrinsic graphic properties of font styles can be captured. Specifically, we formulate a cross modality cycled image to image model structure with a graph constructor between an image encoder and an image renderer. The novel graph constructor maps a glyph's latent code to its graph representation that matches expert knowledge, which is trained to help the translation task. Our model generates improved results than both image to image baseline and previous state of the art methods for glyph completion. Furthermore, the graph representation output by our model also provides an intuitive interface for users to do local editing and manipulation. Our proposed cross modality cycled representation learning has the potential to be applied to other domains with prior knowledge from different data modalities. Our code is available at https github.com VITA Group Font Completion Graph.


Transversals and colorings of simplicial spheres. Motivated from the surrounding property of a point set in mathbb R d introduced by Holmsen, Pach and Tverberg, we consider the transversal number and chromatic number of a simplicial sphere. As an attempt to give a lower bound for the maximum transversal ratio of simplicial d spheres, we provide two infinite constructions. The first construction gives infintely many (d 1) dimensional simplicial polytopes with the transversal ratio exactly frac 2 d 2 for every d geq 2 . In the case of d 2 , this meets the previously well known upper bound 1 2 tightly. The second gives infinitely many simplicial 3 spheres with the transversal ratio greater than 1 2 . This was unexpected from what was previously known about the surrounding property. Moreover, we show that, for d geq 3 , the facet hypergraph mathcal F ( mathbf P ) of a (d 1) dimensional simplicial polytope mathbf P has the chromatic number chi( mathcal F ( mathbf P )) in O(n frac lceil d 2 rceil 1 d ) , where n is the number of vertices of mathbf P . This slightly improves the upper bound previously obtained by Heise, Panagiotou, Pikhurko, and Taraz.


Big Data Generated by Connected and Automated Vehicles for Safety Monitoring, Assessment and Improvement, Final Report (Year 3). This report focuses on safety aspects of connected and automated vehicles (CAVs). The fundamental question to be answered is how can CAVs improve road users' safety? Using advanced data mining and thematic text analytics tools, the goal is to systematically synthesize studies related to Big Data for safety monitoring and improvement. Within this domain, the report systematically compares Big Data initiatives related to transportation initiatives nationally and internationally and provides insights regarding the evolution of Big Data science applications related to CAVs and new challenges. The objectives addressed are 1 Creating a database of Big Data efforts by acquiring reports, white papers, and journal publications 2 Applying text analytics tools to extract key concepts, and spot patterns and trends in Big Data initiatives 3 Understanding the evolution of CAV Big Data in the context of safety by quantifying granular taxonomies and modeling entity relations among contents in CAV Big Data research initiatives, and 4 Developing a foundation for exploring new approaches to tracking and analyzing CAV Big Data and related innovations. The study synthesizes and derives high quality information from innovative research activities undertaken by various research entities through Big Data initiatives. The results can provide a conceptual foundation for developing new approaches for guiding and tracking the safety implications of Big Data and related innovations.


FT TDR Frequency guided Transformer and Top Down Refinement Network for Blind Face Inpainting. Blind face inpainting refers to the task of reconstructing visual contents without explicitly indicating the corrupted regions in a face image. Inherently, this task faces two challenges (1) how to detect various mask patterns of different shapes and contents (2) how to restore visually plausible and pleasing contents in the masked regions. In this paper, we propose a novel two stage blind face inpainting method named Frequency guided Transformer and Top Down Refinement Network (FT TDR) to tackle these challenges. Specifically, we first use a transformer based network to detect the corrupted regions to be inpainted as masks by modeling the relation among different patches. We also exploit the frequency modality as complementary information for improved detection results and capture the local contextual incoherence to enhance boundary consistency. Then a top down refinement network is proposed to hierarchically restore features at different levels and generate contents that are semantically consistent with the unmasked face regions. Extensive experiments demonstrate that our method outperforms current state of the art blind and non blind face inpainting methods qualitatively and quantitatively.


Zipf's law and urban scaling Hypotheses towards a Unified Urban Theory. We propose hypotheses describing the empirical finding of an association between the exponents of urban GDP scaling and Zipf's law for cities. These hypotheses represent various combinations of directional or reciprocal causal links between the two phenomena and include inter and intra city processes. Future theories and models can be motivated with and categorized according to these hypotheses. This paper intends to stimulate the discussion around the processes behind these phenomena and pave the way to a Unified Urban Theory.


A large scale study on human cloned changes for automated program repair. Research in automatic program repair has shown that real bugs can be automatically fixed. However, there are several challenges involved in such a task that are not yet fully addressed. As an example, consider that a test suite based repair tool performs a change in a program to fix a bug spotted by a failing test case, but then the same or another test case fails. This could mean that the change is a partial fix for the bug or that another bug was manifested. However, the repair tool discards the change and possibly performs other repair attempts. One might wonder if the applied change should be also applied in other locations in the program so that the bug is fully fixed. In this paper, we are interested in investigating the extent of bug fix changes being cloned by developers within patches. Our goal is to investigate the need of multi location repair by using identical or similar changes in identical or similar contexts. To do so, we analyzed 3,049 multi hunk patches from the ManySStuBs4J dataset, which is a large dataset of single statement bug fix changes. We found out that 68 of the multi hunk patches contain at least one change clone group. Moreover, most of these patches (70 ) are strictly cloned ones, which are patches fully composed of changes belonging to one single change clone group. Finally, most of the strictly cloned patches (89 ) contain change clones with identical changes, independently of their contexts. We conclude that automated solutions for creating patches composed of identical or similar changes can be useful for fixing bugs.


Uncertainty aware INVASE Enhanced Breast Cancer Diagnosis Feature Selection. In this paper, we present an uncertainty aware INVASE to quantify predictive confidence of healthcare problem. By introducing learnable Gaussian distributions, we lever age their variances to measure the degree of uncertainty. Based on the vanilla INVASE, two additional modules are proposed, i.e., an uncertainty quantification module in the predictor, and a reward shaping module in the selector. We conduct extensive experiments on UCI WDBC dataset. Notably, our method eliminates almost all predictive bias with only about 20 queries, while the uncertainty agnostic counterpart requires nearly 100 queries. The open source implementation with a detailed tutorial is available at https github.com jx zhong for academic purpose Uncertainty aware INVASE blob main tutorialinvase 2B.ipynb.


Redundancy in string cone inequalities and multiplicities in potential functions on cluster varieties. We study defining inequalities of string cones via a potential function on a reduced double Bruhat cell. We give a necessary criterion for the potential function to provide a minimal set of inequalities via tropicalization and conjecture an equivalence.


Uniform in time L infty estimates for an attraction repulsion chemotaxis system with double saturation. In this paper we focus on an attraction repulsion chemotaxis model with consumed signals, formulated in bounded and smooth domains Omega of R n , with n geq 2 . We derive sufficient conditions on its data yielding global and bounded classical solutions to the related zero flux Cauchy problem.


What do pre trained code models know about code?. Pre trained models of code built on the transformer architecture have performed well on software engineering (SE) tasks such as predictive code generation, code summarization, among others. However, whether the vector representations from these pre trained models comprehensively encode characteristics of source code well enough to be applicable to a broad spectrum of downstream tasks remains an open question. One way to investigate this is with diagnostic tasks called probes. In this paper, we construct four probing tasks (probing for surface level, syntactic, structural, and semantic information) for pre trained code models. We show how probes can be used to identify whether models are deficient in (understanding) certain code properties, characterize different model layers, and get insight into the model sample efficiency. We probe four models that vary in their expected knowledge of code properties BERT (pre trained on English), CodeBERT and CodeBERTa (pre trained on source code, and natural language documentation), and GraphCodeBERT (pre trained on source code with dataflow). While GraphCodeBERT performs more consistently overall, we find that BERT performs surprisingly well on some code tasks, which calls for further investigation.


Capacity of the range of branching random walks in low dimensions. Consider a branching random walk (V u) u in mathcal T IGW in mathbb Z d with the genealogy tree mathcal T IGW formed by a sequence of i.i.d. critical Galton Watson trees. Let R n be the set of points in mathbb Z d visited by (V u) when the index u explores the first n subtrees in mathcal T IGW . Our main result states that for d in 3, 4, 5 , the capacity of R n is almost surely equal to n frac d 2 2 o(1) as n to infty .


HSVA Hierarchical Semantic Visual Adaptation for Zero Shot Learning. Zero shot learning (ZSL) tackles the unseen class recognition problem, transferring semantic knowledge from seen classes to unseen ones. Typically, to guarantee desirable knowledge transfer, a common (latent) space is adopted for associating the visual and semantic domains in ZSL. However, existing common space learning methods align the semantic and visual domains by merely mitigating distribution disagreement through one step adaptation. This strategy is usually ineffective due to the heterogeneous nature of the feature representations in the two domains, which intrinsically contain both distribution and structure variations. To address this and advance ZSL, we propose a novel hierarchical semantic visual adaptation (HSVA) framework. Specifically, HSVA aligns the semantic and visual domains by adopting a hierarchical two step adaptation, i.e., structure adaptation and distribution adaptation. In the structure adaptation step, we take two task specific encoders to encode the source data (visual domain) and the target data (semantic domain) into a structure aligned common space. To this end, a supervised adversarial discrepancy (SAD) module is proposed to adversarially minimize the discrepancy between the predictions of two task specific classifiers, thus making the visual and semantic feature manifolds more closely aligned. In the distribution adaptation step, we directly minimize the Wasserstein distance between the latent multivariate Gaussian distributions to align the visual and semantic distributions using a common encoder. Finally, the structure and distribution adaptation are derived in a unified framework under two partially aligned variational autoencoders. Extensive experiments on four benchmark datasets demonstrate that HSVA achieves superior performance on both conventional and generalized ZSL. The code is available at url https github.com shiming chen HSVA .


Eliciting Gestures for Novel Note taking Interactions. Handwriting recognition is improving in leaps and bounds, and this opens up new opportunities for stylus based interactions. In particular, note taking applications can become a more intelligent user interface, incorporating new features like autocomplete and integrated search. In this work we ran a gesture elicitation study, asking 21 participants to imagine how they would interact with an imaginary, intelligent note taking application. We report agreement on the elicited gestures, finding that while existing common interactions are prevalent (like double taps and long presses) a number of more novel interactions (like dragging selected items to hotspots or using annotations) were also well represented. We discuss the mental models participants drew on when explaining their gestures and what kind of feedback users might need to move to more stylus centric interactions.


On Explicit Stochastic Differential Algebraic Equations. Dynamical systems that are subject to continuous uncertain fluctuations can be modelled using Stochastic Differential Equations (SDEs). Controlling such systems results in solving path constrained SDEs. Broadly, these problems fall under the category of Stochastic Differential Algebraic Equations (SDAEs). In this article, the focus is on combining ideas from the local theory of Differential Algebraic Equations with that of Stochastic Differential Equations. The question of existence and uniqueness of the solution for SDAEs is addressed by using contraction mapping theorem in an appropriate Banach space to arrive at a sufficient condition. From the geometric point of view, a necessary condition is derived for the existence of the solution. It is observed that there exists a class of high index SDAEs for which there is no solution. Hence, computational methods to find approximate solution of high index equations are presented. The techniques are illustrated in form of algorithms with examples and numerical computations.


Quadruped Locomotion on Non Rigid Terrain using Reinforcement Learning. Legged robots need to be capable of walking on diverse terrain conditions. In this paper, we present a novel reinforcement learning framework for learning locomotion on non rigid dynamic terrains. Specifically, our framework can generate quadruped locomotion on flat elastic terrain that consists of a matrix of tiles moving up and down passively when pushed by the robot's feet. A trained robot with 55cm base length can walk on terrain that can sink up to 5cm. We propose a set of observation and reward terms that enable this locomotion in which we found that it is crucial to include the end effector history and end effector velocity terms into observation. We show the effectiveness of our method by training the robot with various terrain conditions.


RPR Net A Point Cloud based Rotation aware Large Scale Place Recognition Network. Point cloud based large scale place recognition is an important but challenging task for many applications such as Simultaneous Localization and Mapping (SLAM). Taking the task as a point cloud retrieval problem, previous methods have made delightful achievements. However, how to deal with catastrophic collapse caused by rotation problems is still under explored. In this paper, to tackle the issue, we propose a novel Point Cloud based Rotation aware Large Scale Place Recognition Network (RPR Net). In particular, to solve the problem, we propose to learn rotation invariant features in three steps. First, we design three kinds of novel Rotation Invariant Features (RIFs), which are low level features that can hold the rotation invariant property. Second, using these RIFs, we design an attentive module to learn rotation invariant kernels. Third, we apply these kernels to previous point cloud features to generate new features, which is the well known SO(3) mapping process. By doing so, high level scene specific rotation invariant features can be learned. We call the above process an Attentive Rotation Invariant Convolution (ARIConv). To achieve the place recognition goal, we build RPR Net, which takes ARIConv as a basic unit to construct a dense network architecture. Then, powerful global descriptors used for retrieval based place recognition can be sufficiently extracted from RPR Net. Experimental results on prevalent datasets show that our method achieves comparable results to existing state of the art place recognition models and significantly outperforms other rotation invariant baseline models when solving rotation problems.


On SDVS Sender Privacy In The Multi Party Setting. Strong designated verifier signature schemes rely on sender privacy to hide the identity of the creator of a signature to all but the intended recipient. This property can be invaluable in, for example, the context of deniability, where the identity of a party should not be deducible from the communication sent during a protocol execution. In this work, we explore the technical definition of sender privacy and extend it from a 2 party setting to an n party setting. Afterwards, we show in which cases this extension provides a stronger security and in which cases it does not.


GenNI Human AI Collaboration for Data Backed Text Generation. Table2Text systems generate textual output based on structured data utilizing machine learning. These systems are essential for fluent natural language interfaces in tools such as virtual assistants however, left to generate freely these ML systems often produce misleading or unexpected outputs. GenNI (Generation Negotiation Interface) is an interactive visual system for high level human AI collaboration in producing descriptive text. The tool utilizes a deep learning model designed with explicit control states. These controls allow users to globally constrain model generations, without sacrificing the representation power of the deep learning models. The visual interface makes it possible for users to interact with AI systems following a Refine Forecast paradigm to ensure that the generation system acts in a manner human users find suitable. We report multiple use cases on two experiments that improve over uncontrolled generation approaches, while at the same time providing fine grained control. A demo and source code are available at https genni.vizhub.ai .


A modified block alternating splitting iteration method for solving a class of two by two block complex linear systems. A modified version of the block alternating splitting (MBAS) iteration method is presented for solving the system arising from finite element discretization of the distributed optimal control problem with time periodic parabolic equations. We prove that the MBAS iteration method is unconditionally convergent. We also present an estimation formula for the iteration parameter of the MBAS preconditioner. Numerical results are presented to verify the efficiency of both the MBAS iteration method and the MBAS preconditioner.


Distinguishing the aftershock sequences of the DPRK5 and DPRK6 underground nuclear tests. The rate of aftershocks in the sequence initiated by the DPRK underground tests has been increasing since January 2021. In total, 22 reliable aftershocks were detected between January 13 and October 1, 2021. Their characteristics are similar to the aftershocks in one of two clusters 1) the fifth DPRK (DPRK5) test (mb(IDC) 5.09) conducted on September 9, 2016, which induced the first DPRK aftershock in the sequence detected at 1 50 48 UTC on September 11, 2016 2) the sixth DPRK (DPRK6) explosion (mb(IDC) 6.07), which generates its aftershock sequence with characteristics significantly different from the aftershocks in the DPRK5 sequence. The length, intensity, and alternating character of these sequences suggest specific mechanisms of energy release likely associated with the interaction of the damaged zones of the DPRK5 and DPRK6 and the collapse of their cavities with progressive propagation of the collapsing chimneys to the free surface. According to the depth estimates based on the moment tensor modelling, the DPRK5 and DPRK6 were conducted at practically the same depths. The difference in magnitudes suggests that their damaged zones differ by a factor of 2 or more. The first aftershock of the DPRK6 (mb(IDC 4.12) 8.5 minutes after the test is evidence of the cavity collapse and creation of a chimney, which did not reach the surface. The activity in 2021 indicates that the chimney collapse is not finished yet. One can expect more aftershocks in the near future, likely ended with the chimney reaching the free surface.


Reiterman's Theorem on Finite Algebras for a Monad. Profinite equations are an indispensable tool for the algebraic classification of formal languages. Reiterman's theorem states that they precisely specify pseudovarieties, i.e. classes of finite algebras closed under finite products, subalgebras and quotients. In this paper, Reiterman's theorem is generalized to finite Eilenberg Moore algebras for a monad T on a category D we prove that a class of finite T algebras is a pseudovariety iff it is presentable by profinite equations. As a key technical tool, we introduce the concept of a profinite monad associated to the monad T, which gives a categorical view of the construction of the space of profinite terms.


Occlusion Aware Kernel Correlation Filter Tracker using RGB D. Unlike deep learning which requires large training datasets, correlation filter based trackers like Kernelized Correlation Filter (KCF) uses implicit properties of tracked images (circulant matrices) for training in real time. Despite their practical application in tracking, a need for a better understanding of the fundamentals associated with KCF in terms of theoretically, mathematically, and experimentally exists. This thesis first details the workings prototype of the tracker and investigates its effectiveness in real time applications and supporting visualizations. We further address some of the drawbacks of the tracker in cases of occlusions, scale changes, object rotation, out of view and model drift with our novel RGB D Kernel Correlation tracker. We also study the use of particle filters to improve trackers' accuracy. Our results are experimentally evaluated using a) standard dataset and b) real time using the Microsoft Kinect V2 sensor. We believe this work will set the basis for a better understanding of the effectiveness of kernel based correlation filter trackers and to further define some of its possible advantages in tracking.


A Monolithic Algebraic Multigrid Framework for Multiphysics Applications with Examples from Resistive MHD. A multigrid framework is described for multiphysics applications. The framework allows one to construct, adapt, and tailor a monolithic multigrid methodology to different linear systems coming from discretized partial differential equations. The main idea centers on developing multigrid components in a blocked fashion where each block corresponds to separate sets of physical unknowns and equations within the larger discretization matrix. Once defined, these components are ultimately assembled into a monolithic multigrid solver for the entire system. We demonstrate the potential of the framework by applying it to representative linear solution sub problems arising from resistive MHD.


Feedback Capacity of MIMO Gaussian Channels. Finding a computable expression for the feedback capacity of additive channels with colored Gaussian noise is a long standing open problem. In this paper, we solve this problem in the scenario where the channel has multiple inputs and multiple outputs (MIMO) and the noise process is generated as the output of a state space model (a hidden Markov model). The main result is a computable characterization of the feedback capacity as a finite dimensional convex optimization problem. Our solution subsumes all previous solutions to the feedback capacity including the auto regressive moving average (ARMA) noise process of first order, even if it is a non stationary process. The capacity problem can be viewed as the problem of maximizing the measurements' entropy rate of a controlled (policy dependent) state space subject to a power constraint. We formulate the finite block version of this problem as a emph sequential convex optimization problem , which in turn leads to a single letter and computable upper bound. By optimizing over a family of time invariant policies that correspond to the channel inputs distribution, a tight lower bound is realized. We show that one of the optimization constraints in the capacity characterization boils down to a Riccati equation, revealing an interesting relation between explicit capacity formulae and Riccati equations.


Truth and Subjunctive Theories of Knowledge No Luck?. The paper explores applications of Kripke's theory of truth to semantics for anti luck epistemology, that is, to subjunctive theories of knowledge. Subjunctive theories put forward modal or subjunctive conditions to rule out knowledge by mere luck as to be found in Gettier style counterexamples to the analysis of knowledge as justified true belief. Because of the subjunctive nature of these conditions the resulting semantics turns out to be non monotone, even if it is based on non classical evaluation schemes such as strong Kleene or FDE. This blocks the usual road to fixed point results for Kripke's theory of truth within these semantics and consequently the paper is predominantly an exploration of fixed point results for Kripke's theory of truth within non monotone semantics. Using the theory of quasi inductive definitions we show that in case of the subjunctive theories of knowledge the so called Kripke jump will have fixed points despite the non monotonicity of the semantics Kripke's theory of truth can be successfully applied in the framework of subjunctive theories of knowledge.


A Hybrid Approach to Measure Semantic Relatedness in Biomedical Concepts. Objective This work aimed to demonstrate the effectiveness of a hybrid approach based on Sentence BERT model and retrofitting algorithm to compute relatedness between any two biomedical concepts. Materials and Methods We generated concept vectors by encoding concept preferred terms using ELMo, BERT, and Sentence BERT models. We used BioELMo and Clinical ELMo. We used Ontology Knowledge Free (OKF) models like PubMedBERT, BioBERT, BioClinicalBERT, and Ontology Knowledge Injected (OKI) models like SapBERT, CoderBERT, KbBERT, and UmlsBERT. We trained all the BERT models using Siamese network on SNLI and STSb datasets to allow the models to learn more semantic information at the phrase or sentence level so that they can represent multi word concepts better. Finally, to inject ontology relationship knowledge into concept vectors, we used retrofitting algorithm and concepts from various UMLS relationships. We evaluated our hybrid approach on four publicly available datasets which also includes the recently released EHR RelB dataset. EHR RelB is the largest publicly available relatedness dataset in which 89 of terms are multi word which makes it more challenging. Results Sentence BERT models mostly outperformed corresponding BERT models. The concept vectors generated using the Sentence BERT model based on SapBERT and retrofitted using UMLS related concepts achieved the best results on all four datasets. Conclusions Sentence BERT models are more effective compared to BERT models in computing relatedness scores in most of the cases. Injecting ontology knowledge into concept vectors further enhances their quality and contributes to better relatedness scores.


Modular forms, projective structures, and the four squares theorem. It is well known that Lagrange's four square theorem, stating that every natural number may be written as the sum of four squares, may be proved using methods from the classical theory of modular forms and theta functions. We revisit this proof. In doing so, we concentrate on geometry and thereby avoid some of the tricky analysis that is often encountered. Guided by projective differential geometry we find a new route to Lagrange's theorem.


A Broad persistent Advising Approach for Deep Interactive Reinforcement Learning in Robotic Environments. Deep Reinforcement Learning (DeepRL) methods have been widely used in robotics to learn about the environment and acquire behaviors autonomously. Deep Interactive Reinforcement Learning (DeepIRL) includes interactive feedback from an external trainer or expert giving advice to help learners choosing actions to speed up the learning process. However, current research has been limited to interactions that offer actionable advice to only the current state of the agent. Additionally, the information is discarded by the agent after a single use that causes a duplicate process at the same state for a revisit. In this paper, we present Broad persistent Advising (BPA), a broad persistent advising approach that retains and reuses the processed information. It not only helps trainers to give more general advice relevant to similar states instead of only the current state but also allows the agent to speed up the learning process. We test the proposed approach in two continuous robotic scenarios, namely, a cart pole balancing task and a simulated robot navigation task. The obtained results show that the performance of the agent using BPA improves while keeping the number of interactions required for the trainer in comparison to the DeepIRL approach.


A note on perturbation analysis for T product based tensor singular values. In this note, we present perturbation analysis for the T product based tensor singular values defined by Lu et al. First, the Cauchy's interlacing type theorem for tensor singular values is given. Then, the inequalities about the difference between the singular values of two matrices proposed by Mirsky are extended to tensor cases. Finally, we introduce some useful inequalities for the singular values of tensor products and sums.


Kaehler Ricci solitons induced by infinite dimensional complex space forms. We exhibit families of non trivial (i.e. not Kaehler Einstein) radial Kaehler Ricci solitons (KRS), both complete and not complete, which can be Kaehler immersed into infinite dimensional complex space forms. This result shows that the triviality of a KRS induced by a finite dimensional complex space form proved in 12 does not hold when the ambient space is allowed to be infinite dimensional. Moreover, we show that the radial potential of a radial KRS induced by a non elliptic complex space form is necessarily defined at the origin.


The Effect of Class Definitions on the Transferability of Adversarial Attacks Against Forensic CNNs. In recent years, convolutional neural networks (CNNs) have been widely used by researchers to perform forensic tasks such as image tampering detection. At the same time, adversarial attacks have been developed that are capable of fooling CNN based classifiers. Understanding the transferability of adversarial attacks, i.e. an attacks ability to attack a different CNN than the one it was trained against, has important implications for designing CNNs that are resistant to attacks. While attacks on object recognition CNNs are believed to be transferrable, recent work by Barni et al. has shown that attacks on forensic CNNs have difficulty transferring to other CNN architectures or CNNs trained using different datasets. In this paper, we demonstrate that adversarial attacks on forensic CNNs are even less transferrable than previously thought even between virtually identical CNN architectures! We show that several common adversarial attacks against CNNs trained to identify image manipulation fail to transfer to CNNs whose only difference is in the class definitions (i.e. the same CNN architectures trained using the same data). We note that all formulations of class definitions contain the unaltered class. This has important implications for the future design of forensic CNNs that are robust to adversarial and anti forensic attacks.


From Research to Proof of Concept Analysis of a Deployment of FPGAs on a Commercial Search Engine. FPGAs are quickly becoming available in the cloud as a one more heterogeneous processing element complementing CPUs and GPUs. There are many reports in the literature showing the potential for FPGAs to accelerate a wide variety of algorithms, which combined with their growing availability, would seem to also indicate a widespread use in many applications. Unfortunately, there is not much published research exploring what it takes to integrate an FPGA into an existing application in a cost effective way and keeping the algorithmic performance advantages. Building on recent results exploring how to employ FPGAs to improve the search engines used in the travel industry, this paper analyses the end to end performance of the search engine when using FPGAs, as well as the necessary changes to the software and the cost of such deployments. The results provide important insights on current FPGA deployments and what needs to be done to make FPGAs more widely used. For instance, the large potential performance gains provided by an FPGA are greatly diminished in practice if the application cannot submit request in the most optimal way, something that is not always possible and might require significant changes to the application. Similarly, some existing cloud deployments turn out to use a very imbalanced architecture a powerful FPGA connected to a not so powerful CPU. The result is that the CPU cannot generate enough load for the FPGA, which potentially eliminates all performance gains and might even result in a more expensive system. In this paper, we report on an extensive study and development effort to incorporate FPGAs into a search engine and analyse the issues encountered and their practical impact. We expect that these results will inform the development and deployment of FPGAs in the future by providing important insights on the end to end integration of FPGAs within existing systems.


Theory of Probability and Statistics as Exemplified in Short Dictums. I am presenting a first ever scientific collection of short sayings on probability and statistics expressed by most various men of science, many classics included, from antiquity to Kepler to our time. Quite understandably, the reader will find here no mathematical formulas and in some instances he will miss a worthy subject. Markov chains provide a good example their inventor had not said anything about them suitable for my goal. Nevertheless, the scope of the collected dictums is amazingly broad which reflects both the discussions concerning the lack of a solid foundation of probability theory until the 1930s and the great extent of applications of probability and statistics. And I have also included two related and most important topics, the treatment of observations and randomness.


Text Based Person Search with Limited Data. Text based person search (TBPS) aims at retrieving a target person from an image gallery with a descriptive text query. Solving such a fine grained cross modal retrieval task is challenging, which is further hampered by the lack of large scale datasets. In this paper, we present a framework with two novel components to handle the problems brought by limited data. Firstly, to fully utilize the existing small scale benchmarking datasets for more discriminative feature learning, we introduce a cross modal momentum contrastive learning framework to enrich the training data for a given mini batch. Secondly, we propose to transfer knowledge learned from existing coarse grained large scale datasets containing image text pairs from drastically different problem domains to compensate for the lack of TBPS training data. A transfer learning method is designed so that useful information can be transferred despite the large domain gap. Armed with these components, our method achieves new state of the art on the CUHK PEDES dataset with significant improvements over the prior art in terms of Rank 1 and mAP. Our code is available at https github.com BrandonHanx TextReID.


Rational homology disk smoothings of surface singularities the exceptional cases. It is known (Stipsicz Szab 'o Wahl) that there are exactly three triply infinite and seven singly infinite families of weighted homogeneous normal surface singularities admitting a rational homology disk ( mathbb Q HD) smoothing, i.e., having a Milnor fibre with Milnor number zero. Some examples are found by an explicit "quotient construction", while others require the "Pinkham method". The fundamental group of the Milnor fibre has been known for all except the three exceptional families mathcal B 2 3(p), mathcal C 3 2(p), and mathcal C 3 3(p) . In this paper, we settle these cases. We present a new explicit construction for the mathcal B 2 3(p) family, showing the fundamental group is non abelian (as occurred previously only for the mathcal A 4(p), mathcal B 4(p) and mathcal C 4(p) cases). We show that the fundamental groups for mathcal C 3 2(p) and mathcal C 3 3(p) are abelian, hence easily computed using the Pinkham method here requires precise calculations for the fundamental group of the complement of a plane curve.