Local distributional chaos. In discrete dynamical system (X, f) where X is a topological space and f in C(X,X) , three notions of distributional chaos were defined. They were denoted by DC1, DC2 and DC3 . For interval systems such three notions coincide and they will be denoted by DC chaos. Generally speaking we have DC1 subseteq DC2 subseteq DC3 chaos. We wonder if it is possible that chaos can concentrate in some points and develop a local idea of the distributional chaos. Answering to this question, in 12 is introduced the new notion of DCi points for i 1,2,3 . Such special points are those in which DC chaos of different types concentrate. Also in 12 it is proved that if f is continuous interval map with positive topological entropy, then there is at least one DC1 point in the system. In this paper it is proved that in the symbolic space ( Sigma, sigma) where sigma is the shift map, every point of Sigma is a DC1 point. This result is necessary to prove one of the main results of the paper. If h(f) 0 for an interval system, then it has an uncountable set of DC1 points and moreover the set can be chosen perfect. In greater dimensions than one, we deal with triangular systems on I 2 . In this case the relationship between topological entropy and different cases of distributional chaos is not clearly understood and several different results are possible. In the paper we use an example of F given by Kolyada in 9 to prove that the corresponding two dimensional system (I 2 , F) has positive topological entropy but without containing DC2 points, proving that there is no concentration of DC2 chaos


From Behavioral Theories to Econometrics Inferring Preferences of Human Agents from Data on Repeated Interactions. We consider the problem of estimating preferences of human agents from data of strategic systems where the agents repeatedly interact. Recently, it was demonstrated that a new estimation method called "quantal regret" produces more accurate estimates for human agents than the classic approach that assumes that agents are rational and reach a Nash equilibrium however, this method has not been compared to methods that take into account behavioral aspects of human play. In this paper we leverage equilibrium concepts from behavioral economics for this purpose and ask how well they perform compared to the quantal regret and Nash equilibrium methods. We develop four estimation methods based on established behavioral equilibrium models to infer the utilities of human agents from observed data of normal form games. The equilibrium models we study are quantal response equilibrium, action sampling equilibrium, payoff sampling equilibrium, and impulse balance equilibrium. We show that in some of these concepts the inference is achieved analytically via closed formulas, while in the others the inference is achieved only algorithmically. We use experimental data of 2x2 games to evaluate the estimation success of these behavioral equilibrium methods. The results show that the estimates they produce are more accurate than the estimates of the Nash equilibrium. The comparison with the quantal regret method shows that the behavioral methods have better hit rates, but the quantal regret method performs better in terms of the overall mean squared error, and we discuss the differences between the methods.


Forces from stochastic density functional theory under nonorthogonal atom centered basis sets. We develop a formalism for calculating forces on the nuclei within the linear scaling stochastic density functional theory (sDFT) in a nonorthogonal atom centered basis set representation (Fabian et al. WIREs Comput Mol Sci. 2019 e1412. https doi.org 10.1002 wcms.1412) and apply it to Tryptophan Zipper 2 (Trp zip2) peptide solvated in water. We use an embedded fragment approach to reduce the statistical errors (fluctuation and systematic bias), where the entire peptide is the main fragment and the remaining 425 water molecules are grouped into small fragments. We analyze the magnitude of the statistical errors in the forces and find that the systematic bias is of the order of 0.065 ,eV r A ( sim1.2 times10 3 E h a 0 ) when 120 stochastic orbitals are used, independently of systems size. This magnitude of bias is sufficiently small to ensure that the bond lengths estimated by stochastic DFT (within a Langevin molecular dynamics simulation) will deviate by less than 1 from those predicted by a deterministic calculation.


For the Purpose of Curry A UD Treebank for Ashokan Prakrit. We present the first linguistically annotated treebank of Ashokan Prakrit, an early Middle Indo Aryan dialect continuum attested through Emperor Ashoka Maurya's 3rd century BCE rock and pillar edicts. For annotation, we used the multilingual Universal Dependencies (UD) formalism, following recent UD work on Sanskrit and other Indo Aryan languages. We touch on some interesting linguistic features that posed issues in annotation regnal names and other nominal compounds, "proto ergative" participial constructions, and possible grammaticalizations evidenced by sandhi (phonological assimilation across morpheme boundaries). Eventually, we plan for a complete annotation of all attested Ashokan texts, towards the larger goals of improving UD coverage of different diachronic stages of Indo Aryan and studying language change in Indo Aryan using computational methods.


FENeRF Face Editing in Neural Radiance Fields. Previous portrait image generation methods roughly fall into two categories 2D GANs and 3D aware GANs. 2D GANs can generate high fidelity portraits but with low view consistency. 3D aware GAN methods can maintain view consistency but their generated images are not locally editable. To overcome these limitations, we propose FENeRF, a 3D aware generator that can produce view consistent and locally editable portrait images. Our method uses two decoupled latent codes to generate corresponding facial semantics and texture in a spatial aligned 3D volume with shared geometry. Benefiting from such underlying 3D representation, FENeRF can jointly render the boundary aligned image and semantic mask and use the semantic mask to edit the 3D volume via GAN inversion. We further show such 3D representation can be learned from widely available monocular image and semantic mask pairs. Moreover, we reveal that joint learning semantics and texture helps to generate finer geometry. Our experiments demonstrate that FENeRF outperforms state of the art methods in various face editing tasks.


On products of nuclear operators. We answer in negative to the following question of Boris Mitjagin Is it true that a product of two nuclear operators in Banach spaces can be factored through a trace class operator in a Hilbert space?


Volunteer contributions to Wikipedia increased during COVID 19 mobility restrictions. Wikipedia, the largest encyclopedia ever created, is a global initiative driven by volunteer contributions. When the COVID 19 pandemic broke out and mobility restrictions ensued across the globe, it was unclear whether Wikipedia volunteers would become less active in the face of the pandemic, or whether they would rise to meet the increased demand for high quality information despite the added stress inflicted by this crisis. Analyzing 223 million edits contributed from 2018 to 2020 across twelve Wikipedia language editions, we find that Wikipedia's global volunteer community responded remarkably to the pandemic, substantially increasing both productivity and the number of newcomers who joined the community. For example, contributions to the English Wikipedia increased by over 20 compared to the expectation derived from pre pandemic data. Our work sheds light on the response of a global volunteer population to the COVID 19 crisis, providing valuable insights into the behavior of critical online communities under stress.


Graph Based Answer Set Programming Solver Systems. Answer set programming (ASP) is a popular nonmonotonic logic based paradigm for knowledge representation and solving combinatorial problems. Computing the answer set of an ASP program is NP hard in general, and researchers have been investing significant effort to speed it up. The majority of current ASP solvers employ SAT solver like technology to find these answer sets. As a result, justification for why a literal is in the answer set is hard to produce. There are dependency graph based approaches to find answer sets, but due to the representational limitations of dependency graphs, such approaches are limited. This paper proposes a novel dependency graph based approach for finding answer sets in which conjunction of goals is explicitly represented as a node which allows arbitrary answer set programs to be uniformly represented. Our representation preserves causal relationships allowing for justification for each literal in the answer set to be elegantly found. In this paper, we explore two different approaches based on the graph representation bottom up and top down. The bottom up approach finds models by assigning truth values along with the topological order, while the top down approach generates models starting from the constraints.


Noisy Channel Language Model Prompting for Few Shot Text Classification. We introduce a noisy channel approach for language model prompting in few shot text classification. Instead of computing the likelihood of the label given the input (referred as direct models), channel models compute the conditional probability of the input given the label, and are thereby required to explain every word in the input. We use channel models for recently proposed few shot learning methods with no or very limited updates to the language model parameters, via either in context demonstration or prompt tuning. Our experiments show that, for both methods, channel models significantly outperform their direct counterparts, which we attribute to their stability, i.e., lower variance and higher worst case accuracy. We also present extensive ablations that provide recommendations for when to use channel prompt tuning instead of other competitive methods (e.g., direct head tuning) channel prompt tuning is preferred when the number of training examples is small, labels in the training data are imbalanced, or generalization to unseen labels is required.


AirNet Neural Network Transmission over the Air. State of the art performance for many emerging edge applications is achieved by deep neural networks (DNNs). Often, the employed DNNs are location and time dependent, and the parameters of a specific DNN must be delivered from an edge server to the edge device rapidly and efficiently to carry out time sensitive inference tasks. This can be considered as a joint source channel coding (JSCC) problem, in which the goal is not to recover the DNN coefficients with the minimal distortion, but in a manner that provides the highest accuracy in the downstream task. For this purpose we introduce AirNet, a novel training and analog transmission method to deliver DNNs over the air. We first train the DNN with noise injection to counter the wireless channel noise. We also employ pruning to identify the most significant DNN parameters that can be delivered within the available channel bandwidth, knowledge distillation, and non linear bandwidth expansion to provide better error protection for the most important network parameters. We show that AirNet achieves significantly higher test accuracy compared to the separation based alternative, and exhibits graceful degradation with channel quality.


Buoyancy effects on film boiling heat transfer over a sphere at low velocities. A theoretical model is developed for the forced convection film boiling phenomenon over a heated sphere moving vertically downwards in the water. Unprecedented to the previous analytical studies, this model accounts for the buoyancy effects while solving the momentum, and energy equations in the vapor phase to obtain the velocity, and the temperature distribution in terms of the vapor boundary layer thickness. To calculate the vapor boundary layer thickness an energy balance is applied at the vapor liquid interface. The flow of liquid around the sphere is considered to be governed by the potential theory, and the energy equation in liquid is then solved for the known velocity distribution. We find that the vapor boundary layer thickness increases with an increase in the sphere, and the bulk water temperature, and a decrease in the free stream velocity. This further results in a decrease in the film boiling heat transfer coefficient. The present study concludes that at low free stream velocities ( 0.5 m s) buoyancy becomes significant in delaying the separation, and when the velocity is further reduced the separation angle approaches 180 circ .


Private Retrieval, Computing and Learning Recent Progress and Future Challenges. Most of our lives are conducted in the cyberspace. The human notion of privacy translates into a cyber notion of privacy on many functions that take place in the cyberspace. This article focuses on three such functions how to privately retrieve information from cyberspace (privacy in information retrieval), how to privately leverage large scale distributed parallel processing (privacy in distributed computing), and how to learn train machine learning models from private data spread across multiple users (privacy in distributed (federated) learning). The article motivates each privacy setting, describes the problem formulation, summarizes breakthrough results in the history of each problem, and gives recent results and discusses some of the major ideas that emerged in each field. In addition, the cross cutting techniques and interconnections between the three topics are discussed along with a set of open problems and challenges.


Positive crossratios, barycenters, trees and applications to maximal representations. We study metric properties of maximal framed representations of fundamental groups of surfaces in symplectic groups over real closed fields, interpreted as actions on Bruhat Tits buildings endowed with adapted Finsler norms. We prove that the translation length can be computed as intersection with a geodesic current, give sufficient conditions guaranteeing that such a current is a multicurve, and, if the current is a measured lamination, construct an isometric embedding of the associated tree in the building. These results are obtained as application of more general results of independent interest on positive crossratios and actions with compatible barycenters.


Secure and Efficient Federated Learning Through Layering and Sharding Blockchain. Federated learning (FL) has emerged as a promising master slave learning paradigm to alleviate systemic privacy risks and communication costs incurred by cloud centric machine learning methods. However, it is very challenging to resist the single point of failure of the master aggregator and attacks from malicious participants while guaranteeing model convergence speed and accuracy. Recently, blockchain has been brought into FL systems transforming the paradigm to a decentralized manner thus further improve the system security and learning reliability. Unfortunately, the traditional consensus mechanism and architecture of blockchain systems can hardly handle the large scale FL task due to the huge resource consumption, limited transaction throughput, and high communication complexity. To address these issues, this paper proposes a two layer blockchaindriven FL framework, called as ChainsFL, which is composed of multiple subchain networks (subchain layer) and a direct acyclic graph (DAG) based mainchain (mainchain layer). In ChainsFL, the subchain layer limits the scale of each shard for a small range of information exchange, and the mainchain layer allows each shard to share and validate the learning model in parallel and asynchronously to improve the efficiency of cross shard validation. Furthermore, the FL procedure is customized to deeply integrate with blockchain technology, and the modified DAG consensus mechanism is proposed to mitigate the distortion caused by abnormal models. In order to provide a proof ofconcept implementation and evaluation, multiple subchains base on Hyperledger Fabric are deployed as the subchain layer, and the self developed DAG based mainchain is deployed as the mainchain layer. The experimental results show that ChainsFL provides acceptable and sometimes better training efficiency and stronger robustness compared with the typical existing FL systems.


Location Data and COVID 19 Contact Tracing How Data Privacy Regulations and Cell Service Providers Work In Tandem. Governments, Healthcare, and Private Organizations in the global scale have been using digital tracking to keep COVID 19 outbreaks under control. Although this method could limit pandemic contagion, it raises significant concerns about user privacy. Known as "Contact Tracing Apps", these mobile applications are facilitated by Cellphone Service Providers (CSPs), who enable the spatial and temporal real time user tracking. Accordingly, it might be speculated that CSPs collect information violating the privacy policies such as GDPR, CCPA, and others. To further clarify, we conducted an in depth analysis comparing privacy legislations with the real world practices adapted by CSPs. We found that three of the regulations (GDPR, COPPA, and CCPA) analyzed defined mobile location data as private information, and two (T Mobile US, Boost Mobile) of the five CSPs that were analyzed did not comply with the COPPA regulation. Our results are crucial in view of the threat these violations represent, especially when it comes to children's data. As such proper security and privacy auditing is necessary to curtail such violations. We conclude by providing actionable recommendations to address concerns and provide privacy preserving monitoring of the COVID 19 spread through the contact tracing applications.


Analytical solution to the radiotherapy fractionation problem including dose bound constraints. This paper deals with the classic radiotherapy dose fractionation problem for cancer tumors concerning the following goals a) To maximize the effect of radiation on the tumor, restricting the effect produced to the organs at risk (healing approach). b) To minimize the effect of radiation on the organs at risk, while maintaining enough effect of radiation on the tumor (palliative approach). We will assume the linear quadratic model to characterize the radiation effect and consider the stationary case (that is, without taking into account the timing of doses and the tumor growth between them). The main novelty with respect to previous works concerns the presence of minimum and maximum dose fractions, to achieve the minimum effect and to avoid undesirable side effects, respectively. We have characterized in which situations is more convenient the hypofractionated protocol (deliver few fractions with high dose per fraction) and in which ones the hyperfractionated regimen (deliver a large number of lower doses of radiation) is the optimal strategy. In all cases, analytical solutions to the problem are obtained in terms of the data. In addition, the calculations to implement these solutions are elementary and can be carried out using a pocket calculator.


Investigation of Nonlinear Model Order Reduction of the Quasigeostrophic Equations through a Physics Informed Convolutional Autoencoder. Reduced order modeling (ROM) is a field of techniques that approximates complex physics based models of real world processes by inexpensive surrogates that capture important dynamical characteristics with a smaller number of degrees of freedom. Traditional ROM techniques such as proper orthogonal decomposition (POD) focus on linear projections of the dynamics onto a set of spectral features. In this paper we explore the construction of ROM using autoencoders (AE) that perform nonlinear projections of the system dynamics onto a low dimensional manifold learned from data. The approach uses convolutional neural networks (CNN) to learn spatial features as opposed to spectral, and utilize a physics informed (PI) cost function in order to capture temporal features as well. Our investigation using the quasi geostrophic equations reveals that while the PI cost function helps with spatial reconstruction, spatial features are less powerful than spectral features, and that construction of ROMs through machine learning based methods requires significant investigation into novel non standard methodologies.


In situ Thermal Transport Measurement of Flowing Fluid using Modulated Photothermal Radiometry. In situ thermal transport measurement of flowing fluid could be useful for the characterization and diagnosis of practical thermal systems such as fluid heat exchangers and thermal energy storage systems. Despite abundant reports on the ex situ thermal conductivity measurement of stagnant fluids, a suitable technique for the thermal conductivity measurement of flowing fluid has been rarely reported. This paper presents the thermal conductivity measurement of flowing fluid within a pipe using a non contact modulated photothermal radiometry (MPR) technique, where the surface of the pipe is heated by an intensity modulated laser and the heat diffuses into the fluid with suitable modulation frequency. We design a tube section with small wall thickness suitable for the MPR measurements to maximize the sensitivity of the thermal response to the fluid properties while minimizing the lateral heat spreading effect. Intrinsic thermal conductivity of different fluids was obtained within a proper range of frequency and flow velocity where the forced convection effect is negligible. The forced convection effect became prominent at high flowing velocity and at low modulation frequency, leading to overestimated thermal conductivity of fluid. It is found that the intrinsic thermal conductivity could be obtained when the flow velocity is less than 100 mm sec and ReD1 2Pr1 3 100 for DI water and Xceltherm oil under the specified experimental conditions, where Re D is the Reynolds number and Pr is the Prandtl number.


Beyond Image to Depth Improving Depth Prediction using Echoes. We address the problem of estimating depth with multi modal audio visual data. Inspired by the ability of animals, such as bats and dolphins, to infer distance of objects with echolocation, some recent methods have utilized echoes for depth estimation. We propose an end to end deep learning based pipeline utilizing RGB images, binaural echoes and estimated material properties of various objects within a scene. We argue that the relation between image, echoes and depth, for different scene elements, is greatly influenced by the properties of those elements, and a method designed to leverage this information can lead to significantly improved depth estimation from audio visual inputs. We propose a novel multi modal fusion technique, which incorporates the material properties explicitly while combining audio (echoes) and visual modalities to predict the scene depth. We show empirically, with experiments on Replica dataset, that the proposed method obtains 28 improvement in RMSE compared to the state of the art audio visual depth prediction method. To demonstrate the effectiveness of our method on larger dataset, we report competitive performance on Matterport3D, proposing to use it as a multimodal depth prediction benchmark with echoes for the first time. We also analyse the proposed method with exhaustive ablation experiments and qualitative results. The code and models are available at https krantiparida.github.io projects bimgdepth.html


Stable vectors in dual Vinberg representations of F 4 . This paper gives a classification of stable vectors in dual Vinberg representations coming from a graded Lie algebra of type F 4 in a way that is independent of the field of definition. Relating these gradings to Moy Prasad filtrations, we obtain the input for Reeder Yu's construction of epipelagic supercuspidal representations. As a corollary, this construction gives new supercuspidal representations of F 4( mathbb Q p) when p is small.


An introduction to six functor formalisms. These are notes for a mini course given at the summer school and conference "The Six Functor Formalism and Motivic Homotopy Theory" in Milan 9 2021. They provide an introduction to the formalism of Grothendieck's six operations in algebraic geometry and end with an excursion to rigid analytic motives. The notes do not correspond precisely to the lectures delivered but provide a more self contained account for the benefit of the audience and others. No originality is claimed.


Complexity of natural numbers. This is the English version of the paper "Complejidad de los n 'umeros naturales", Gaceta de la Real Sociedad Matem 'atica Espa nola 3 (2000) 230 250. In this paper, several conjectures about the complexity of natural numbers are proposed. In a recent joint paper with H. Altman "Integer Complexity, stability, and self similarity" arXiv 2111.00671, we resolve the last of these conjectures. This is why I consider its translation useful now as a reference.


Stein trisections and homotopy 4 balls. A homotopy 4 ball is a smooth 4 manifold with boundary S 3 that is homotopy equivalent to the standard B 4 . The smooth 4 dimensional Schoenflies problem asks whether every homotopy 4 ball in S 4 (or equivalently mathbb C 2 ) is standard. It is well known that if a homotopy 4 ball embeds as a compact, pseudoconvex domain in a Stein surface, then it must be standard. In this paper, we describe a compelling reimbedding construction for homotopy 4 balls in mathbb C 2 . In particular, given a homotopy 4 ball in mathbb C 2 , we construct a diffeomorphic domain that is the union of three pseudoconvex domains. Moreover, we give an analytic criterion that ensures this domain is a standard 4 ball.


"Grip that there" An Investigation of Explicit and Implicit Task Allocation Techniques for Human Robot Collaboration. In ad hoc human robot collaboration (HRC), humans and robots work on a task without pre planning the robot's actions prior to execution instead, task allocation occurs in real time. However, prior research has largely focused on task allocations that are pre planned there has not been a comprehensive exploration or evaluation of techniques where task allocation is adjusted in real time. Inspired by HCI research on territoriality and proxemics, we propose a design space of novel task allocation techniques including both explicit techniques, where the user maintains agency, and implicit techniques, where the efficiency of automation can be leveraged. The techniques were implemented and evaluated using a tabletop HRC simulation in VR. A 16 participant study, which presented variations of a collaborative block stacking task, showed that implicit techniques enable efficient task completion and task parallelization, and should be augmented with explicit mechanisms to provide users with fine grained control.


Methodology proposal for proactive detection of network anomalies in e learning system during the COVID 19 scenario. In specific conditions and crisis situations such as the pandemic of coronavirus (SARS CoV 2), or the COVID 19 disease, e learning systems be came crucial for the smooth performing of teaching and other educational pro cesses. In such scenarios, the availability of e learning ecosystem elements is further highlighted. An indicator of the importance for securing the availability of such an ecosystem is evident from the DDoS (Distributed Denial of Service) attack on AAI EduHr as a key authentication service for number of e learning users in Republic of Croatia. In doing so, numerous users (teach ers students administrators) were prevented from implementing and participat ing in the planned teaching process. Given that DDoS as an anomaly of network traffic has been identified as one of the key threats to the e learning ecosystem in crisis scenarios, this research will focus on overview of methodology for de veloping a model for proactive detection of DDoS traffic. The challenge in de tection is to effectively differentiate the increased traffic intensity and service requests caused by legitimate user activity (flash crowd) from the illegitimate traffic caused by a DDoS attack. The DDoS traffic detection model developed by following analyzed methodology would serve as a basis for providing further guidelines and recommendations in the form of response to events that may negatively affect the availability of e learning ecosystem elements such as DDoS attack.


Distributed Saddle Point Problems Under Similarity. We study solution methods for (strongly )convex (strongly) concave Saddle Point Problems (SPPs) over networks of two type master workers (thus centralized) architectures and meshed (thus decentralized) networks. The local functions at each node are assumed to be similar, due to statistical data similarity or otherwise. We establish lower complexity bounds for a fairly general class of algorithms solving the SPP. We show that a given suboptimality epsilon 0 is achieved over master workers networks in Omega big( Delta cdot delta mu cdot log (1 varepsilon) big) rounds of communications, where delta 0 measures the degree of similarity of the local functions, mu is their strong convexity constant, and Delta is the diameter of the network. The lower communication complexity bound over meshed networks reads Omega big(1 sqrt rho cdot delta mu cdot log (1 varepsilon) big) , where rho is the (normalized) eigengap of the gossip matrix used for the communication between neighbouring nodes. We then propose algorithms matching the lower bounds over either types of networks (up to log factors). We assess the effectiveness of the proposed algorithms on a robust logistic regression problem.


Generation of tunable optical skyrmions on Skyrme Poincar 'e sphere. In recent time, the optical analogous skyrmions, topological quasiparticles with sophisticated vectorial structures, have received an increasing amount of interest. Here we propose theortically and experimentally a generalized family of these, the tunable optical skyrmion, unveiling a new mechanism to transform between various skyrmionic topologies, including N 'eel , Bloch , and antiskyrmion types, via simple parametric tuning. In addition, Poincar 'e like geometric representation is proposed to visualize the topological evolution of tunable skyrmions, which we termed Skyrme Poincar 'e sphere, akin to the spin orbit representation of complex vector modes. To generate experimentally the tunable optical skyrmions we implemented a digital hologram system based on a spatial light modulator, showing great agreement with our theoretical prediction.


UbiNIRS A Software Framework for Miniaturized NIRS based Applications. We present UbiNIRS, a software framework for rapid development and deployment of applications using miniaturized near infrared spectroscopy (NIRS). NIRS is an emerging material sensing technology that has shown a great potential in recent work from the HCI community such as in situ pill testing. However, existing methods require significant programming efforts and professional knowledge of NIRS, and hence, challenge the creation of new NIRS based applications. Our system helps to resolve this issue by providing a generic server and a mobile app, using the best practices for NIRS applications in literature. The server creates and manages UbiNIRS instances without the need for any coding or professional knowledge of NIRS. The mobile app can register multiple UbiNIRS instances by communicating with the server for different NIRS based applications. Furthermore, UbiNIRS enables NIRS spectrum crowdsourcing for building a knowledge base.


Dynamic Distillation Network for Cross Domain Few Shot Recognition with Unlabeled Data. Most existing works in few shot learning rely on meta learning the network on a large base dataset which is typically from the same domain as the target dataset. We tackle the problem of cross domain few shot learning where there is a large shift between the base and target domain. The problem of cross domain few shot recognition with unlabeled target data is largely unaddressed in the literature. STARTUP was the first method that tackles this problem using self training. However, it uses a fixed teacher pretrained on a labeled base dataset to create soft labels for the unlabeled target samples. As the base dataset and unlabeled dataset are from different domains, projecting the target images in the class domain of the base dataset with a fixed pretrained model might be sub optimal. We propose a simple dynamic distillation based approach to facilitate unlabeled images from the novel base dataset. We impose consistency regularization by calculating predictions from the weakly augmented versions of the unlabeled images from a teacher network and matching it with the strongly augmented versions of the same images from a student network. The parameters of the teacher network are updated as exponential moving average of the parameters of the student network. We show that the proposed network learns representation that can be easily adapted to the target domain even though it has not been trained with target specific classes during the pretraining phase. Our model outperforms the current state of the art method by 4.4 for 1 shot and 3.6 for 5 shot classification in the BSCD FSL benchmark, and also shows competitive performance on traditional in domain few shot learning task.


MERLOT Multimodal Neural Script Knowledge Models. As humans, we understand events in the visual world contextually, performing multimodal reasoning across time to make inferences about the past, present, and future. We introduce MERLOT, a model that learns multimodal script knowledge by watching millions of YouTube videos with transcribed speech in an entirely label free, self supervised manner. By pretraining with a mix of both frame level (spatial) and video level (temporal) objectives, our model not only learns to match images to temporally corresponding words, but also to contextualize what is happening globally over time. As a result, MERLOT exhibits strong out of the box representations of temporal commonsense, and achieves state of the art performance on 12 different video QA datasets when finetuned. It also transfers well to the world of static images, allowing models to reason about the dynamic context behind visual scenes. On Visual Commonsense Reasoning, MERLOT answers questions correctly with 80.6 accuracy, outperforming state of the art models of similar size by over 3 , even those that make heavy use of auxiliary supervised data (like object bounding boxes). Ablation analyses demonstrate the complementary importance of 1) training on videos versus static images 2) scaling the magnitude and diversity of the pretraining video corpus and 3) using diverse objectives that encourage full stack multimodal reasoning, from the recognition to cognition level.


Initial successive coefficients for certain classes of univalent functions. We consider a family of all analytic and univalent functions in the unit disk of the form f(z) z a 2z 2 a 3z 3 cdots . The aim of this article is to investigate the bounds of the difference of moduli of initial successive coefficients, i.e. big a n 1 a n big for n 1, ,2 and for some subclasses of analytic univalent functions. We found that all the estimations are sharp in nature by constructing some extremal functions.


Data Hunches Incorporating Personal Knowledge into Visualizations. The trouble with data is that it frequently provides only an imperfect representation of a phenomenon of interest. Experts who are familiar with their datasets will often make implicit, mental corrections when analyzing a dataset, or will be cautious not to be over confident in any findings if caveats are present. However, the implicit knowledge about the caveats of a dataset are typically not collected in a structured way, which is problematic especially when teams work together who might have knowledge about different aspects of a dataset. In this work, we define such analyst's knowledge about datasets as data hunches. We discuss the implications of data hunches and propose a set of techniques for recording and communicating data hunches through data visualization. Furthermore, we provide guidelines for designing visualizations that support recording and visualizing data hunches. We envision that data hunches will empower analysts to externalize their knowledge, facilitate collaboration and communication, and support the ability to learn from others' data hunches.


Smallest non cyclic quotients of the automorphism group of free groups. We give an new, elementary proof of the result that the smallest non cyclic quotients of automorphism group of free group is the linear group over the field of two elements, and moreover all minimal quotients are obtained by the standard projection composed with an automorphism of the image. This result, originally due to Baumeister Kielak Pierro, proves a conjecture of Mecchia Zimmermann.


Generation and characterisation of isolated attosecond pulses at 100kHz repetition rate. The generation of coherent light pulses in the extreme ultraviolet (XUV) spectral region with attosecond pulse durations constitutes the foundation of the field of attosecond science. Twenty years after the first demonstration of isolated attosecond pulses, they continue to be a unique tool enabling the observation and control of electron dynamics in atoms, molecules and solids. It has long been identified that an increase in the repetition rate of attosecond light sources is necessary for many applications in atomic and molecular physics, surface science, and imaging. Although high harmonic generation (HHG) at repetition rates exceeding 100 kHz, showing a continuum in the cut off region of the XUV spectrum was already demonstrated in 2013, the number of photons per pulse was insufficient to perform pulse characterisation via attosecond streaking, let alone to perform a pump probe experiment. Here we report on the generation and full characterisation of XUV attosecond pulses via HHG driven by near single cycle pulses at a repetition rate of 100 kHz. The high number of 10 6 XUV photons per pulse on target enables attosecond electron streaking experiments through which the XUV pulses are determined to consist of a dominant single attosecond pulse. These results open the door for attosecond pump probe spectroscopy studies at a repetition rate one or two orders of magnitude above current implementations.


On the structure of alpha limit sets of backward trajectories for graph maps. In the paper we study what sets can be obtained as alpha limit sets of backward trajectories in graph maps. We show that in the case of mixing maps, all those alpha limit sets are omega limit sets and for all but finitely many points x , we can obtain every omega limits set as the alpha limit set of a backward trajectory starting in x . For zero entropy maps, every alpha limit set of a backward trajectory is a minimal set. In the case of maps with positive entropy, we obtain a partial characterization which is very close to complete picture of the possible situations.


Collapsing the Decision Tree the Concurrent Data Predictor. A family of concurrent data predictors is derived from the decision tree classifier by removing the limitation of sequentially evaluating attributes. By evaluating attributes concurrently, the decision tree collapses into a flat structure. Experiments indicate improvements of the prediction accuracy.


Categorification of ice quiver mutation. In 2009, Keller and Yang categorified quiver mutation by interpreting it in terms of equivalences between derived categories. Their approach was based on Ginzburg's Calabi Yau algebras and on Derksen Weyman Zelevinsky's mutation of quivers with potential. Recently, Matthew Pressland has generalized mutation of quivers with potential to that of ice quivers with potential. In this paper, we show that his rule yields derived equivalences between the associated relative Ginzburg algebras, which are special cases of Yeung's deformed relative Calabi Yau completions arising in the theory of relative Calabi Yau structures due to To "en and Brav Dyckerhoff. We illustrate our results on examples arising in the work of Baur King Marsh on dimer models and cluster categories of Grassmannians. We also give a categorification of mutation at frozen vertices as it appears in recent work of Fraser Sherman Bennett on positroid cluster structures.


Upgraded Metallurgical Grade Silicon for solar electricity production a comparative Life Cycle Assessment. Solar grade silicon (SoG Si) is a key material for the development of crystalline silicon photovoltaics (PV), which is expected to reach the tera watt level in the next years and around 50TW in 2050. Upgraded metallurgical grade silicon (UMG Si) has already demonstrated to be a viable alternative to standard polysilicon in terms of cost and quality. This study presents the life cycle assessment (LCA) of UMG obtained by the FerroSolar process. Moreover, it shows the environmental impacts of PV modules and electricity generation based on this material. For this, an exhaustive review of the life cycle inventory (LCI) of PV value chain, from metallurgical grade silicon (MG Si) down to electricity generation, has been carried out updating inputs for all processes. The Balance of System (BoS) has also been updated with real state of the art data for a fixed open ground large PV site (100 MW). Two different electricity mixes, with low and high carbon intensities, have been considered. The results reveal that for PV electricity generation using UMG instead of polysilicon leads to an overall reduction of Climate change (CC) emissions of over 20 , along with an improvement of the Energy Payback Time (EPBT) of 25 , achieving significantly low values, 12 gCO2eq kWhe and 0.52 years, respectively. Moreover, it is shown that UMG silicon feedstock is not the main contributor to the carbon and energy footprint of the produced electricity, leaving the first place to PV module manufacturing.


Chern currents of coherent sheaves. Given a finite locally free resolution of a coherent analytic sheaf mathcal F , equipped with Hermitian metrics and connections, we construct an explicit current, obtained as the limit of certain smooth Chern forms of mathcal F , that represents the Chern class of mathcal F and has support on the support of mathcal F . If the connections are (1,0) connections and mathcal F has pure dimension, then the first nontrivial component of this Chern current coincides with (a constant times) the fundamental cycle of mathcal F . The proof of this goes through a generalized Poincar 'e Lelong formula, previously obtained by the authors, and a result that relates the Chern current to the residue current associated with the locally free resolution.


MoFE Mixture of Factual Experts for Controlling Hallucinations in Abstractive Summarization. Neural abstractive summarization models are susceptible to generating factually inconsistent content, a phenomenon known as hallucination. This limits the usability and adoption of these systems in real world applications. To reduce the presence of hallucination, we propose the Mixture of Factual Experts (MoFE) model, which combines multiple summarization experts that each target a specific type of error. We train our experts using reinforcement learning (RL) to minimize the error defined by two factual consistency metrics entity overlap and dependency arc entailment. We construct MoFE by combining the experts using two ensembling strategies (weights and logits) and evaluate them on two summarization datasets (XSUM and CNN DM). Our experiments on BART models show that the MoFE improves performance according to both entity overlap and dependency arc entailment, without a significant performance drop on standard ROUGE metrics. The performance improvement also transfers to unseen factual consistency metrics, such as question answer based factuality evaluation metric and BERTScore precision with respect to the source document.


Regenerating Soft Robots through Neural Cellular Automata. Morphological regeneration is an important feature that highlights the environmental adaptive capacity of biological systems. Lack of this regenerative capacity significantly limits the resilience of machines and the environments they can operate in. To aid in addressing this gap, we develop an approach for simulated soft robots to regrow parts of their morphology when being damaged. Although numerical simulations using soft robots have played an important role in their design, evolving soft robots with regenerative capabilities have so far received comparable little attention. Here we propose a model for soft robots that regenerate through a neural cellular automata. Importantly, this approach only relies on local cell information to regrow damaged components, opening interesting possibilities for physical regenerable soft robots in the future. Our approach allows simulated soft robots that are damaged to partially regenerate their original morphology through local cell interactions alone and regain some of their ability to locomote. These results take a step towards equipping artificial systems with regenerative capacities and could potentially allow for more robust operations in a variety of situations and environments. The code for the experiments in this paper is available at url github.com KazuyaHoribe RegeneratingSoftRobots .


House of algebraic integers symmetric about the unit circle. We give a Schinzel Zassenhaus type lower bound for the maximum modulus of roots of a monic integer polynomial with all roots symmetric with respect to the unit circle. Our results extend a recent work of Dimitrov, who proved the general Schinzel Zassenhaus conjecture by using the P 'olya rationality theorem for a power series with integer coefficients, and some estimates for logarithmic capacity (transfinite diameter) of sets. We use an enhancement of P 'olya's result obtained by Robinson, which involves Laurent type rational functions with small supremum norms, thereby replacing the logarithmic capacity with a smaller quantity. This smaller quantity is expressed via a weighted Chebyshev constant for the set associated with Dimitrov's function used in Robinson's rationality theorem. Our lower bound for the house confirms a conjecture of Boyd.


A review of one phase Hele Shaw flows and a level set method for non standard configurations. The classical model for studying one phase Hele Shaw flows is based on a highly nonlinear moving boundary problem with the fluid velocity related to pressure gradients via a Darcy type law. In a standard configuration with the Hele Shaw cell made up of two flat stationary plates, the pressure is harmonic. Therefore, conformal mapping techniques and boundary integral methods can be readily applied to study the key interfacial dynamics, including the Saffman Taylor instability and viscous fingering patterns. As well as providing a brief review of these key issues, we present a flexible numerical scheme for studying both standard and non standard Hele Shaw flows. Our method consists of using a modified finite difference stencil in conjunction with the level set method to solve the governing equation for pressure on complicated domains and track the location of the moving boundary. Simulations show that our method is capable of reproducing the distinctive morphological features of the Saffman Taylor instability on a uniform computational grid. By making straightforward adjustments, we show how our scheme can easily be adapted to solve for a wide variety of non standard configurations, including cases where the gap between the plates is linearly tapered, the plates are separated in time, and the entire Hele Shaw cell is rotated at a given angular velocity.


OpenFL An open source framework for Federated Learning. Federated learning (FL) is a computational paradigm that enables organizations to collaborate on machine learning (ML) projects without sharing sensitive data, such as, patient records, financial data, or classified secrets. Open Federated Learning (OpenFL https github.com intel openfl) is an open source framework for training ML algorithms using the data private collaborative learning paradigm of FL. OpenFL works with training pipelines built with both TensorFlow and PyTorch, and can be easily extended to other ML and deep learning frameworks. Here, we summarize the motivation and development characteristics of OpenFL, with the intention of facilitating its application to existing ML model training in a production environment. Finally, we describe the first use of the OpenFL framework to train consensus ML models in a consortium of international healthcare organizations, as well as how it facilitates the first computational competition on FL.


Contrastive Language Image Pre training for the Italian Language. CLIP (Contrastive Language Image Pre training) is a very recent multi modal model that jointly learns representations of images and texts. The model is trained on a massive amount of English data and shows impressive performance on zero shot classification tasks. Training the same model on a different language is not trivial, since data in other languages might be not enough and the model needs high quality translations of the texts to guarantee a good performance. In this paper, we present the first CLIP model for the Italian Language (CLIP Italian), trained on more than 1.4 million image text pairs. Results show that CLIP Italian outperforms the multilingual CLIP model on the tasks of image retrieval and zero shot classification.


Approximately controllable finite dimensional bilinear systems are controllable. We show that a bilinear control system is approximately controllable if and only if it is controllable in mathbb R n setminus 0 . We approach this problem by looking at the foliation made by the orbits of the system, and by showing that there does not exist a codimension one foliation in mathbb R n setminus 0 with dense leaves that are everywhere transversal to the radial direction. The proposed geometric approach allows to extend the results to homogeneous systems that are angularly controllable.


Versatile modular neural locomotion control with fast learning. Legged robots have significant potential to operate in highly unstructured environments. The design of locomotion control is, however, still challenging. Currently, controllers must be either manually designed for specific robots and tasks, or automatically designed via machine learning methods that require long training times and yield large opaque controllers. Drawing inspiration from animal locomotion, we propose a simple yet versatile modular neural control structure with fast learning. The key advantages of our approach are that behavior specific control modules can be added incrementally to obtain increasingly complex emergent locomotion behaviors, and that neural connections interfacing with existing modules can be quickly and automatically learned. In a series of experiments, we show how eight modules can be quickly learned and added to a base control module to obtain emergent adaptive behaviors allowing a hexapod robot to navigate in complex environments. We also show that modules can be added and removed during operation without affecting the functionality of the remaining controller. Finally, the control approach was successfully demonstrated on a physical hexapod robot. Taken together, our study reveals a significant step towards fast automatic design of versatile neural locomotion control for complex robotic systems.


Self immolative chemistry in nanomedicine. Self Immolative Chemistry is based on the cascade of disassembling reactions triggered by the adequate stimulation and leading to the sequential release of the smaller constituent elements. This review will focus on the possibilities that this type of chemistry offers to nanomedicine research, which is an area where the stimuli responsive behavior is always targeted. There are some examples on the use of self immolative chemistry for prodrugs or nanoparticles for drug delivery, but there is still an exciting land of opportunities waiting to be explored. This review aims at revising what has been done so far, but, most importantly, it aims at inspiring new research of self immolative chemistry on nanomedicine.


WaCoDiS Automated Earth Observation Data Processing within an Event Driven Architecture for Water Monitoring. To ensure an efficient and environmentally friendly water resource management, water management associations need means for efficient water monitoring as well as novel strategies to reduce the pollution of surface and ground water. Traditionally, water management associations operate large sensor networks to suffice their needs for hydrological and meteorological measurement data to monitor and model physical processes within catchments. Implementing a comprehensive monitoring system often suffers from sparse coverage of in situ data. Due to the evolvement of the Copernicus satellite platforms, the broader availability of satellite data provides a great potential for deriving complementary information from Earth Observation data. Although the number of satellite data platforms that provide online processing environments is growing, it is still a big challenge to integrate those platforms into traditional workflows of users from environmental domains such as hydrology. Thus, in this paper, we introduce a software architecture to facilitate the generation of Earth Observation information targeted towards hydrology. The presented WaCoDiS System comprises several microservices as well standardized interfaces that enable a platform independent processing of satellite data. First, we discuss the contribution of Earth Observation data to water monitoring and derive several challenges regarding the facilitation of satellite data processing. We then describe our system design with a brief overview about the different system components which form an automated processing pipeline. The suitability of our system is proven as part of a pre operational deployment for a German water management association. In addition, we demonstrate how our system is capable of integrating satellite data platforms, using the Copernicus Data and Exploitation Platform Deutschland (CODE DE) as a reference example.


Risk Analysis and Policy Enforcement of Function Interactions in Robot Apps. Robot apps are becoming more automated, complex and diverse. An app usually consists of many functions, interacting with each other and the environment. This allows robots to conduct various tasks. However, it also opens a new door for cyber attacks adversaries can leverage these interactions to threaten the safety of robot operations. Unfortunately, this issue is rarely explored in past works. We present the first systematic investigation about the function interactions in common robot apps. First, we disclose the potential risks and damages caused by malicious interactions. We introduce a comprehensive graph to model the function interactions in robot apps by analyzing 3,100 packages from the Robot Operating System (ROS) platform. From this graph, we identify and categorize three types of interaction risks. Second, we propose RTron, a novel system to detect and mitigate these risks and protect the operations of robot apps. We introduce security policies for each type of risks, and design coordination nodes to enforce the policies and regulate the interactions. We conduct extensive experiments on 110 robot apps from the ROS platform and two complex apps (Baidu Apollo and Autoware) widely adopted in industry. Evaluation results indicated RTron can correctly identify and mitigate all potential risks with negligible performance cost. To validate the practicality of the risks and solutions, we implement and evaluate RTron on a physical UGV (Turtlebot) with real word apps and environments.


Connecting Language and Vision for Natural Language Based Vehicle Retrieval. Vehicle search is one basic task for the efficient traffic management in terms of the AI City. Most existing practices focus on the image based vehicle matching, including vehicle re identification and vehicle tracking. In this paper, we apply one new modality, i.e., the language description, to search the vehicle of interest and explore the potential of this task in the real world scenario. The natural language based vehicle search poses one new challenge of fine grained understanding of both vision and language modalities. To connect language and vision, we propose to jointly train the state of the art vision models with the transformer based language model in an end to end manner. Except for the network structure design and the training strategy, several optimization objectives are also re visited in this work. The qualitative and quantitative experiments verify the effectiveness of the proposed method. Our proposed method has achieved the 1st place on the 5th AI City Challenge, yielding competitive performance 18.69 MRR accuracy on the private test set. We hope this work can pave the way for the future study on using language description effectively and efficiently for real world vehicle retrieval systems. The code will be available at https github.com ShuaiBai623 AIC2021 T5 CLV.


Comparison of Automated Machine Learning Tools for SMS Spam Message Filtering. Short Message Service (SMS) is a very popular service used for communication by mobile users. However, this popular service can be abused by executing illegal activities and influencing security risks. Nowadays, many automatic machine learning (AutoML) tools exist which can help domain experts and lay users to build high quality ML models with little or no machine learning knowledge. In this work, a classification performance comparison was conducted between three automatic ML tools for SMS spam message filtering. These tools are mljar supervised AutoML, H2O AutoML, and Tree based Pipeline Optimization Tool (TPOT) AutoML. Experimental results showed that ensemble models achieved the best classification performance. The Stacked Ensemble model, which was built using H2O AutoML, achieved the best performance in terms of Log Loss (0.8370), true positive (1088 1116), and true negative (281 287) metrics. There is a 19.05 improvement in Log Loss with respect to TPOT AutoML and 5.56 improvement with respect to mljar supervised AutoML. The satisfactory filtering performance achieved with AutoML tools provides a potential application for AutoML tools to automatically determine the best ML model that can perform best for SMS spam message filtering.


Robustness and Generalization via Generative Adversarial Training. While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness against these variations. However, current defenses can only withstand the specific attack used in training, and the models often remain vulnerable to other input variations. Moreover, these methods often degrade performance of the model on clean images and do not generalize to out of domain samples. In this paper we present Generative Adversarial Training, an approach to simultaneously improve the model's generalization to the test set and out of domain samples as well as its robustness to unseen adversarial attacks. Instead of altering a low level pre defined aspect of images, we generate a spectrum of low level, mid level and high level changes using generative models with a disentangled latent space. Adversarial training with these examples enable the model to withstand a wide range of attacks by observing a variety of input alterations during training. We show that our approach not only improves performance of the model on clean images and out of domain samples but also makes it robust against unforeseen attacks and outperforms prior work. We validate effectiveness of our method by demonstrating results on various tasks such as classification, segmentation and object detection.


The Rise of a New Digital Third Space Professional in Higher Education Recognising Research Software Engineering. Research Software Engineering is the application of professional software skills to research problems. Those who do this are called Research Software Engineers or RSEs for short. RSEs work closely with researchers in a collaborative fashion rather than just offering a standalone function (c.f. the traditional IT workforce or Librarians working to provide a general set of services to the University community such as research, teaching or administrative functions). It is this overlap with academic researchers that make the RSE and the RSE management a new type of third space professional in the higher education sector. We explore aspects of knowledge, relationships, legitimacies and language in relation to the model constructed by Whitchurch in Reconstructing Identities in Higher Education to explore how these relate to the RSE role and go on to highlight open problems that need resolving to put RSEs on a firmer organisational footing.


Calibration technique for suppressing residual etalon artifacts in slit averaged Raman spectroscopy. Back illuminated charged coupled device (BI CCD) arrays increase quantum efficiency but also amplify etaloning, a multiplicative, wavelength dependent fixed pattern effect. When spectral data from hundreds of BI CCD rows are combined, the averaged spectrum will generally appear etalon free. This can mask substantial etaloning at the row level, even if the BI CCD has been treated to suppress the effect. This Note compares two methods of etalon correction, one with simple averaging and one with row by row calibration using a fluorescence standard. Two BI CCD arrays, both roughened by the supplier to reduce etaloning, were used to acquire Raman spectra of murine bone specimens. For one array, etaloning was the dominant source of noise under the exposure conditions chosen, even for the averaged spectrum across all rows near infrared excited Raman peaks were noticeably affected. In this case, row by row calibration improved the spectral quality of the average spectrum. The other CCD's performance was shot noise limited and therefore received no benefit from the extra calibration. The different results highlight the importance of checking for and correcting row level fixed pattern when measuring weak Raman signals in the presence of a large fluorescence background.


DIG A Turnkey Library for Diving into Graph Deep Learning Research. Although there exist several libraries for deep learning on graphs, they are aiming at implementing basic operations for graph deep learning. In the research community, implementing and benchmarking various advanced tasks are still painful and time consuming with existing libraries. To facilitate graph deep learning research, we introduce DIG Dive into Graphs, a turnkey library that provides a unified testbed for higher level, research oriented graph deep learning tasks. Currently, we consider graph generation, self supervised learning on graphs, explainability of graph neural networks, and deep learning on 3D graphs. For each direction, we provide unified implementations of data interfaces, common algorithms, and evaluation metrics. Altogether, DIG is an extensible, open source, and turnkey library for researchers to develop new methods and effortlessly compare with common baselines using widely used datasets and evaluation metrics. Source code is available at https github.com divelab DIG.


A Survey of Visual Transformers. Transformer, an attention based encoder decoder model, has already revolutionized the field of natural language processing (NLP). Inspired by such significant achievements, some pioneering works have recently been done on employing Transformer liked architectures in the computer vision (CV) field, which have demonstrated their effectiveness on three fundamental CV tasks (classification, detection, and segmentation) as well as multiple sensory data stream (images, point clouds, and vision language data). Because of their competitive modeling capabilities, the visual Transformers have achieved impressive performance improvements over multiple benchmarks as compared with modern Convolution Neural Networks (CNNs). In this survey, we have reviewed over one hundred of different visual Transformers comprehensively according to three fundamental CV tasks and different data stream types, where a taxonomy is proposed to organize the representative methods according to their motivations, structures, and application scenarios. Because of their differences on training settings and dedicated vision tasks, we have also evaluated and compared all these existing visual Transformers under different configurations. Furthermore, we have revealed a series of essential but unexploited aspects that may empower such visual Transformers to stand out from numerous architectures, e.g., slack high level semantic embeddings to bridge the gap between the visual Transformers and the sequential ones. Finally, three promising research directions are suggested for future investment. We will continue to update the latest articles and their released source codes at https github.com liuyang ict awesome visual transformers.


Erd H o s Gy ' a rf ' a s Conjecture for P 8 free graphs. A graph is P 8 free if it contains no induced subgraph isomorphic to the path P 8 on eight vertices. In 1995, Erd H o s and Gy ' a rf ' a s conjectured that every graph of minimum degree at least three contains a cycle whose length is a power of two. In this paper, we confirm the conjecture for P 8 free graphs by showing that there exists a cycle of length four or eight in every P 8 free graph with minimum degree at least three.


Website fingerprinting on early QUIC traffic. Cryptographic protocols have been widely used to protect the user's privacy and avoid exposing private information. QUIC (Quick UDP Internet Connections), including the version originally designed by Google (GQUIC) and the version standardized by IETF (IQUIC), as alternatives to the traditional HTTP, demonstrate their unique transmission characteristics based on UDP for encrypted resource transmitting, accelerating web page rendering. However, existing encrypted transmission schemes based on TCP are vulnerable to website fingerprinting (WFP) attacks, allowing adversaries to infer the users' visited websites by eavesdropping on the transmission channel. Whether GQUIC and IQUIC can effectively resist such attacks is worth investigating. In this paper, we study the vulnerabilities of GQUIC, IQUIC, and HTTPS to WFP attacks from the perspective of traffic analysis. Extensive experiments show that, in the early traffic scenario, GQUIC is the most vulnerable to WFP attacks among GQUIC, IQUIC, and HTTPS, while IQUIC is more vulnerable than HTTPS, but the vulnerability of the three protocols is similar in the normal full traffic scenario. Features transferring analysis shows that most features are transferable between protocols when on normal full traffic scenario. However, combining with the qualitative analysis of latent feature representation, we find that the transferring is inefficient when on early traffic, as GQUIC, IQUIC, and HTTPS show the significantly different magnitude of variation in the traffic distribution on early traffic. By upgrading the one time WFP attacks to multiple WFP Top a attacks, we find that the attack accuracy on GQUIC and IQUIC reach 95.4 and 95.5 , respectively, with only 40 packets and just using simple features, whereas reach only 60.7 when on HTTPS. We also demonstrate that the vulnerability of IQUIC is only slightly dependent on the network environment.


A Simple Voting Mechanism for Online Sexist Content Identification. This paper presents the participation of the MiniTrue team in the EXIST 2021 Challenge on the sexism detection in social media task for English and Spanish. Our approach combines the language models with a simple voting mechanism for the sexist label prediction. For this, three BERT based models and a voting function are used. Experimental results show that our final model with the voting function has achieved the best results among our four models, which means that our voting mechanism brings an extra benefit to our system. Nevertheless, we also observe that our system is robust to data sources and languages.


Perfect Roman domination in middle graphs. The middle graph M(G) of a graph G is the graph obtained by subdividing each edge of G exactly once and joining all these newly introduced vertices of adjacent edges of G . A perfect Roman dominating function on a graph G is a function f V(G) rightarrow 0, 1, 2 satisfying the condition that every vertex v with f(v) 0 is adjacent to exactly one vertex u for which f(u) 2 . The weight of a perfect Roman dominating function f is the sum of weights of vertices. The perfect Roman domination number is the minimum weight of a perfect Roman dominating function on G . In this paper, we give a characterization of middle graphs with equal Roman domination and perfect Roman domination numbers.


Gibbsianness and non Gibbsianness for Bernoulli lattice fields under removal of isolated sites. We consider the i.i.d. Bernoulli field mu p on mathbb Z d with occupation density p in 0,1 . To each realization of the set of occupied sites we apply a thinning map that removes all occupied sites that are isolated in graph distance. We show that, while this map seems non invasive for large p , as it changes only a small fraction p(1 p) 2d of sites, there is p(d) 1 such that for all p in(p(d),1) the resulting measure is a non Gibbsian measure, i.e., it does not possess a continuous version of its finite volume conditional probabilities. On the other hand, for small p , the Gibbs property is preserved.


Scanning Plasmonic Color Display. Control over plasmonic colors on the nanoscale is of great interest for high resolution display, imaging, and information encryption applications. However, so far, very limited schemes have been attempted for dynamic plasmonic color generation. In this paper, we demonstrate a scanning plasmonic color generation scheme, in which subwavelength plasmonic pixels can be laterally switched on off through directional hydrogenation dehydrogenation of a magnesium screen. We show several dynamic plasmonic color displays with different scanning functions by varying the number and geometries of the palladium gates, where hydrogen enters the scanning screens. In particular, we employ the scanning effects to create a dynamic plasmonic quick response code. The information cannot be decrypted by varying the polarization states of light or by accessing the physical features. Rather, it can only be read out using hydrogen as a decoding key. Our work advances the established design concepts for plasmonic color printing and provides insights into the development of optical information storage and anticounterfeiting features.


Optimality Conditions for Bilevel Imaging Learning Problems with Total Variation Regularization. We address the problem of optimal scale dependent parameter learning in total variation image denoising. Such problems are formulated as bilevel optimization instances with total variation denoising problems as lower level constraints. For the bilevel problem, we are able to derive M stationarity conditions, after characterizing the corresponding Mordukhovich generalized normal cone and verifying suitable constraint qualification conditions. We also derive B stationarity conditions, after investigating the Lipschitz continuity and directional differentiability of the lower level solution operator. A characterization of the Bouligand subdifferential of the solution mapping, by means of a properly defined linear system, is provided as well. Based on this characterization, we propose a two phase non smooth trust region algorithm for the numerical solution of the bilevel problem and test it computationally for two particular experimental settings.


Portfolio Theory and Security Investment Risk Analysis Using Coefficient of Variation An Alternative to Mean Variance Analysis. We presented here a direct calculation of risk from the coefficient of variation (CV) using an equation that has been derived here for the first time. We also presented a method to generate stock CV that strongly correlates with performance and consequently, we found that the price growths of stocks with low CVs are approximately exponential which explains previous empirical observations that low risk stocks produce higher returns. From these observations, we posit that we can do away with the mean variance analysis (and the efficient frontier) in building a portfolio. Instead, one must minimize CV (minimize risk) to maximize returns.


Sixteen points in mathbb P 4 and the inverse Galois problem for del Pezzo surfaces of degree one. A del Pezzo surface of degree one defined over the rationals has 240 exceptional curves. These curves are permuted by the action of the absolute Galois group. We show how a solution to the classical inverse Galois problem for a subgroup of the Weyl group of type D 8 gives rise to a solution of the inverse Galois problem for the action of this subgroup on the 240 exceptional curves. A del Pezzo surface of degree one with such a Galois action contains a Galois invariant sublattice of type D 8 within its Picard lattice this can be characterized in terms of a certain set of sixteen points in mathbb P 4 .


Multivariate Analysis of Scheduling Fair Competitions. A emph fair competition , based on the concept of envy freeness, is a non eliminating competition where each contestant (team or individual player) may not play against all other contestants, but the total difficulty for each contestant is the same the sum of the initial rankings of the opponents for each contestant is the same. Similar to other non eliminating competitions like the Round robin competition or the Swiss system competition, the winner of the fair competition is the contestant who wins the most games. The sc Fair Non Eliminating Tournament ( sc Fair NET ) problem can be used to schedule fair competitions whose infrastructure is known. In the sc Fair NET problem, we are given an infrastructure of a tournament represented by a graph G and the initial rankings of the contestants represented by a multiset of integers S . The objective is to decide whether G is emph S fair , i.e., there exists an assignment of the contestants to the vertices of G such that the sum of the rankings of the neighbors of each contestant in G is the same constant k in mathbb N . We initiate a study of the classical and parameterized complexity of sc Fair NET with respect to several central structural parameters motivated by real world scenarios, thereby presenting a comprehensive picture of it.


Patient Outcome and Zero shot Diagnosis Prediction with Hypernetwork guided Multitask Learning. Multitask deep learning has been applied to patient outcome prediction from text, taking clinical notes as input and training deep neural networks with a joint loss function of multiple tasks. However, the joint training scheme of multitask learning suffers from inter task interference, and diagnosis prediction among the multiple tasks has the generalizability issue due to rare diseases or unseen diagnoses. To solve these challenges, we propose a hypernetwork based approach that generates task conditioned parameters and coefficients of multitask prediction heads to learn task specific prediction and balance the multitask learning. We also incorporate semantic task information to improves the generalizability of our task conditioned multitask model. Experiments on early and discharge notes extracted from the real world MIMIC database show our method can achieve better performance on multitask patient outcome prediction than strong baselines in most cases. Besides, our method can effectively handle the scenario with limited information and improve zero shot prediction on unseen diagnosis categories.


Neural Network Ensembles Theory, Training, and the Importance of Explicit Diversity. Ensemble learning is a process by which multiple base learners are strategically generated and combined into one composite learner. There are two features that are essential to an ensemble's performance, the individual accuracies of the component learners and the overall diversity in the ensemble. The right balance of learner accuracy and ensemble diversity can improve the performance of machine learning tasks on benchmark and real world data sets, and recent theoretical and practical work has demonstrated the subtle trade off between accuracy and diversity in an ensemble. In this paper, we extend the extant literature by providing a deeper theoretical understanding for assessing and improving the optimality of any given ensemble, including random forests and deep neural network ensembles. We also propose a training algorithm for neural network ensembles and demonstrate that our approach provides improved performance when compared to both state of the art individual learners and ensembles of state of the art learners trained using standard loss functions. Our key insight is that it is better to explicitly encourage diversity in an ensemble, rather than merely allowing diversity to occur by happenstance, and that rigorous theoretical bounds on the trade off between diversity and learner accuracy allow one to know when an optimal arrangement has been achieved.


LUAI Challenge 2021 on Learning to Understand Aerial Images. This report summarizes the results of Learning to Understand Aerial Images (LUAI) 2021 challenge held on ICCV 2021, which focuses on object detection and semantic segmentation in aerial images. Using DOTA v2.0 and GID 15 datasets, this challenge proposes three tasks for oriented object detection, horizontal object detection, and semantic segmentation of common categories in aerial images. This challenge received a total of 146 registrations on the three tasks. Through the challenge, we hope to draw attention from a wide range of communities and call for more efforts on the problems of learning to understand aerial images.


Transverse instability of the CH KP I equation. The Camassa Holm Kadomtsev Petviashvili I equation (CH KP I) is a two dimensional generalization of the Camassa Holm equation (CH). In this paper, we prove transverse instability of the line solitary waves under periodic transverse perturbations. The proof is based on the framework of the paper written by Rousset and Tzvetkov. Due to the high nonlinearity, our proof requires necessary modification. Specifically, we first establish the linear instability of the line solitary waves. Then through an approximation procedure, we prove that the linear effect actually dominates the nonlinear behavior.


Nonstandard n distances based on certain geometric constructions. The concept of n distance was recently introduced to generalize the classical definition of distance to functions of n arguments. In this paper we investigate this concept through a number of examples based on certain geometrical constructions. In particular, our study shows to which extent the computation of the best constant associated with an n distance may sometimes be difficult and tricky. It also reveals that two important graph theoretical concepts, namely the total length of the Euclidean Steiner tree and the total length of the minimal spanning tree constructed on n points, are instances of n distances.


Finding the unicorn Predicting early stage startup success through a hybrid intelligence method. Artificial intelligence is an emerging topic and will soon be able to perform decisions better than humans. In more complex and creative contexts such as innovation, however, the question remains whether machines are superior to humans. Machines fail in two kinds of situations processing and interpreting soft information (information that cannot be quantified) and making predictions in unknowable risk situations of extreme uncertainty. In such situations, the machine does not have representative information for a certain outcome. Thereby, humans are still the gold standard for assessing soft signals and make use of intuition. To predict the success of startups, we, thus, combine the complementary capabilities of humans and machines in a Hybrid Intelligence method. To reach our aim, we follow a design science research approach to develop a Hybrid Intelligence method that combines the strength of both machine and collective intelligence to demonstrate its utility for predictions under extreme uncertainty.


On The State of Data In Computer Vision Human Annotations Remain Indispensable for Developing Deep Learning Models. High quality labeled datasets play a crucial role in fueling the development of machine learning (ML), and in particular the development of deep learning (DL). However, since the emergence of the ImageNet dataset and the AlexNet model in 2012, the size of new open source labeled vision datasets has remained roughly constant. Consequently, only a minority of publications in the computer vision community tackle supervised learning on datasets that are orders of magnitude larger than Imagenet. In this paper, we survey computer vision research domains that study the effects of such large datasets on model performance across different vision tasks. We summarize the community's current understanding of those effects, and highlight some open questions related to training with massive datasets. In particular, we tackle (a) The largest datasets currently used in computer vision research and the interesting takeaways from training on such datasets (b) The effectiveness of pre training on large datasets (c) Recent advancements and hurdles facing synthetic datasets (d) An overview of double descent and sample non monotonicity phenomena and finally, (e) A brief discussion of lifelong continual learning and how it fares compared to learning from huge labeled datasets in an offline setting. Overall, our findings are that research on optimization for deep learning focuses on perfecting the training routine and thus making DL models less data hungry, while research on synthetic datasets aims to offset the cost of data labeling. However, for the time being, acquiring non synthetic labeled data remains indispensable to boost performance.


Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields. In this paper, we present a novel double diffusion based neural radiance field, dubbed DD NeRF, to reconstruct human body geometry and render the human body appearance in novel views from a sparse set of images. We first propose a double diffusion mechanism to achieve expressive representations of input images by fully exploiting human body priors and image appearance details at two levels. At the coarse level, we first model the coarse human body poses and shapes via an unclothed 3D deformable vertex model as guidance. At the fine level, we present a multi view sampling network to capture subtle geometric deformations and image detailed appearances, such as clothing and hair, from multiple input views. Considering the sparsity of the two level features, we diffuse them into feature volumes in the canonical space to construct neural radiance fields. Then, we present a signed distance function (SDF) regression network to construct body surfaces from the diffused features. Thanks to our double diffused representations, our method can even synthesize novel views of unseen subjects. Experiments on various datasets demonstrate that our approach outperforms the state of the art in both geometric reconstruction and novel view synthesis.


Weakly Abundant Semigroups and variants. A weakly U abundant is a class of semigroups characterized using some generalized Green' relations. In this paper we discuss the variants of weakly U abundant semigroups and it is shown that the idempotent variants of these semigroups are again weakly U abundant. Further we also discuss the natural partial order on variants of a weakly U abundant semigroup.


Deep Reinforcement Learning Models Predict Visual Responses in the Brain A Preliminary Result. Supervised deep convolutional neural networks (DCNNs) are currently one of the best computational models that can explain how the primate ventral visual stream solves object recognition. However, embodied cognition has not been considered in the existing visual processing models. From the ecological standpoint, humans learn to recognize objects by interacting with them, allowing better classification, specialization, and generalization. Here, we ask if computational models under the embodied learning framework can explain mechanisms underlying object recognition in the primate visual system better than the existing supervised models? To address this question, we use reinforcement learning to train neural network models to play a 3D computer game and we find that these reinforcement learning models achieve neural response prediction accuracy scores in the early visual areas (e.g., V1 and V2) in the levels that are comparable to those accomplished by the supervised neural network model. In contrast, the supervised neural network models yield better neural response predictions in the higher visual areas, compared to the reinforcement learning models. Our preliminary results suggest the future direction of visual neuroscience in which deep reinforcement learning should be included to fill the missing embodiment concept.


Occlusion Guided Self supervised Scene Flow Estimation on 3D Point Clouds. Understanding the flow in 3D space of sparsely sampled points between two consecutive time frames is the core stone of modern geometric driven systems such as VR AR, Robotics, and Autonomous driving. The lack of real, non simulated, labeled data for this task emphasizes the importance of self or un supervised deep architectures. This work presents a new self supervised training method and an architecture for the 3D scene flow estimation under occlusions. Here we show that smart multi layer fusion between flow prediction and occlusion detection outperforms traditional architectures by a large margin for occluded and non occluded scenarios. We report state of the art results on Flyingthings3D and KITTI datasets for both the supervised and self supervised training.


Torsion Obstructions to Positive Scalar Curvature. We exhibit new examples of manifolds which admit it no metrics with positive scalar curvatures and such that products of such manifolds admit such metrics.


Explanatory choices for beginning physics teachers "Mathematical efficiency" as a determining criterion. Recent investigations have been carried out on critical analyses of beginning physics teachers confronted with questionable explanations. These studies raise the question of the choices made by teachers for their teaching once they have become aware of one (or more) flaw(s) in the explanations analysed. This presentation will focus on the possible conflicts, for beginning teachers, between various selection criteria declared for their explanations, including appropriateness (from the points of view of internal coherence, logical completeness and compliance with accepted physical laws) and simplicity. It will introduce the definition of "mathematical efficiency" as a criterion for assessing an explanation, on the basis of a study whose results show that it is a priority for some EDs even at the cost of coherence and of simplicity. The article concludes with the implications of the issues addressed for research and teacher training


On the branching convolution equation mathcal E mathcal Z circledast mathcal E . We characterize all random point measures which are in a certain sense stable under the action of branching. Denoting by circledast the branching convolution operation introduced by Bertoin and Mallein (2019), and by mathcal Z the law of a random point measure on the real line, we are interested in solutions to the fixed point equation mathcal E mathcal Z circledast mathcal E, with mathcal E a random point measure distribution. Under suitable assumptions, we characterize all solutions of this equation as shifted decorated Poisson point processes with a uniquely defined shift.


Diffusion of new products with heterogeneous consumers. Does a new product spread faster among heterogeneous or homogeneous consumers? We analyze this question using the stochastic discrete Bass model, in which consumers may differ in their individual external influence rates p j and in their individual internal influence rates q j . When the network is complete and the heterogeneity is only manifested in p j or only in q j , it always slows down the diffusion, compared to the corresponding homogeneous network. When, however, consumers are heterogeneous in both p j and q j , heterogeneity slows down the diffusion in some cases, but accelerates it in others. Moreover, the dominance between the heterogeneous and homogeneous adoption levels is global in time in some cases, but changes with time in others. Perhaps surprisingly, global dominance between two networks is not always preserved under "additive transformations", such as adding an identical node to both networks. When the network is not complete, the effect of heterogeneity depends also on its spatial distribution within the network.


Local mixing of one parameter diagonal flows on Anosov homogeneous spaces. Let G be a connected semisimple real algebraic group and Gamma G be an Anosov subgroup with respect to a minimal parabolic subgroup. We prove local mixing of the one parameter diagonal flow exp(t mathsf v ) t in mathbb R on Gamma backslash G in any interior direction mathsf v of the limit cone of Gamma with respect to the Bowen Margulis Sullivan measure associated to mathsf v . By the work of Edwards Lee Oh which is a higher rank extension of Roblin's transverse intersection argument, an immediate application is an asymptotic formula for matrix coefficients in L 2( Gamma backslash G) .


Zonal profile corrugations and staircase formation Role of the transport crossphase. Recently, quasi stationary structures called E times B staircases were observed in gyrokinetic simulations, in all transport channels Dif Pradalier et al. Phys. Rev. Lett. 114, 085004 (2015) . We present a novel analytical theory supported by collisional drift wave fluid simulations for the generation of density profile corrugations (staircase), independent of the action of zonal flows Turbulent fluctuations self organize to generate quasi stationary radial modulations Delta theta(r,t) of the transport crossphase theta between density and electric potential fluctuations. The radial modulations of the associated particle flux drive zonal corrugations of the density profile, via a modulational instability. In turn, zonal density corrugations regulate the turbulence via nonlinear damping of the fluctuations.


LegaLMFiT Efficient Short Legal Text Classification with LSTM Language Model Pre Training. Large Transformer based language models such as BERT have led to broad performance improvements on many NLP tasks. Domain specific variants of these models have demonstrated excellent performance on a variety of specialised tasks. In legal NLP, BERT based models have led to new state of the art results on multiple tasks. The exploration of these models has demonstrated the importance of capturing the specificity of the legal language and its vocabulary. However, such approaches suffer from high computational costs, leading to a higher ecological impact and lower accessibility. Our findings, focusing on English language legal text, show that lightweight LSTM based Language Models are able to capture enough information from a small legal text pretraining corpus and achieve excellent performance on short legal text classification tasks. This is achieved with a significantly reduced computational overhead compared to BERT based models. However, our method also shows degraded performance on a more complex task, multi label classification of longer documents, highlighting the limitations of this lightweight approach.


cs.LG physics.class-ph physics.comp-ph physics.data-an

Physics Augmented Learning A New Paradigm Beyond Physics Informed Learning. Integrating physical inductive biases into machine learning can improve model generalizability. We generalize the successful paradigm of physics informed learning (PIL) into a more general framework that also includes what we term physics augmented learning (PAL). PIL and PAL complement each other by handling discriminative and generative properties, respectively. In numerical experiments, we show that PAL performs well on examples where PIL is inapplicable or inefficient.


An irrational Lagrangian density of a single hypergraph. The em Tur 'an number of an r uniform graph F , denoted by ex(n,F) , is the maximum number of edges in an F free r uniform graph on n vertices. The em Tur ' a n density of F is defined as pi(F) underset n rightarrow infty lim ex(n,F) over n choose r . For graphs, Erd H o s Stone Simonovits ( cite ESi , cite ES ) showed that Pi infty (2) Pi fin (2) Pi 1 (2) 0, 1 over 2 , 2 over 3 , ldots, l 1 over l , ... . We know quite few about the Tur 'an density of an r uniform graph for r ge 3 . Baber and Talbot cite BT , and Pikhurko cite Pikhurko2 showed that there is an irrational number in Pi 3 (3) and Pi fin (3) respectively, disproving a conjecture of Chung and Graham cite FG . Baber and Talbot cite BT asked whether Pi 1 (r) contains an irrational number. In this paper, we show that the Lagrangian density of F 123, 124, 134, 234, 567 (the disjoint union of K 4 3 and an edge) is sqrt 3 over 3 , consequently, the Tur 'an density of the extension of F is an irrational number, answering the question of Baber and Talbot.


Relaxation approach for learning regularizers by neural networks for a class of optimal control problems. The present paper deals with the data driven design of regularizers in the form of artificial nerual networks, for solving inverse problems formulated as optimal control problems. These regularizers aim at improving accuracy, wellposedness or compensating uncertainties for a class of optimal control problems (inner problems). Parameterized as neural networks, their weights are chosen in order to reduce a misfit between data and observations of the state solution of the inner optimal control problems. Learning these weights constitutes the outer problem. Based on necessary first order optimality conditions for the inner problems, a relaxation approach is proposed in order to implement efficient solving of the inner problems, namely the forward operator of the outer problem. Optimality conditions are derived for the latter, and numerical illustrations show the feasibility of the relaxation approach, first for rediscovering standard L 2 regularizers, and next for designing regularizers that compensate unknown noise on the observed state of the inner problem.


Local fluid pressure perturbations inside faults matter in unexpectedly large injection triggered earthquakes. Anticipating the maximum magnitude of injection triggered earthquakes is highly valuable for the safe and efficient exploitation of geoenergies. The recent work by Li et al.(2021) reached the conclusion that unexpectedly large injection triggered earthquakes are primarily caused by large pre existing critical shear stresses on seismogenic faults. Also of great interest is the proposal of the ratio of fault slip to dilation as an index to anticipate the fault rupture energetics. However, their fluid injection experiments were conducted under fully drained conditions, where the fluid pressure distribution on the fault plane is always uniform. As already pointed out by the authors, local fluid pressure perturbations inside faults under locally undrained conditions also have the potential to cause unexpectedly large seismic events. Here we add more datasets and possible explanations for this viewpoint, which has not been explored in such detail by Li et al.(2021).


Proof of the Tijdeman Zagier Conjecture via Slope Irrationality and Term Coprimality. The Tijdeman Zagier conjecture states no integer solution exists for A X B Y C Z with positive integer bases and integer exponents greater than 2 unless gcd (A,B,C) 1 . Any set of values that satisfy the conjecture correspond to a lattice point on a Cartesian graph which subtends a line in multi dimensional space with the origin. Properties of the slopes of these lines in each plane are established as a function of coprimality of terms, such as irrationality, which enable us to explicitly prove the conjecture by contradiction.


Angles of Arc Polygons and Lombardi Drawings of Cacti. We characterize the triples of interior angles that are possible in non self crossing triangles with circular arc sides, and we prove that a given cyclic sequence of angles can be realized by a non self crossing polygon with circular arc sides whenever all angles are at most pi. As a consequence of these results, we prove that every cactus has a planar Lombardi drawing (a drawing with edges depicted as circular arcs, meeting at equal angles at each vertex) for its natural embedding in which every cycle of the cactus is a face of the drawing. However, there exist planar embeddings of cacti that do not have planar Lombardi drawings.


Next Gen Machine Learning Supported Diagnostic Systems for Spacecraft. Future short or long term space missions require a new generation of monitoring and diagnostic systems due to communication impasses as well as limitations in specialized crew and equipment. Machine learning supported diagnostic systems present a viable solution for medical and technical applications. We discuss challenges and applicability of such systems in light of upcoming missions and outline an example use case for a next generation medical diagnostic system for future space operations. Additionally, we present approach recommendations and constraints for the successful generation and use of machine learning models aboard a spacecraft.